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(54) Predictive digital video signal encoding and decoding method using block Interpolation 



(57) An image encoding apparatus for application to 
images expressed as respective frames of a digital 
video signal, whereby an image is converted into an 
array of blocks with specific blocks predetermined as 
being independent internally encoded blocks (D) and 
the remainder as predictively encoded blocks (A, B, C). 
with predicted pixel signal values for a predictively 
encoded block being derived by interpolation from pixel 
signal values of at least one pair of blocks which have 
been already encoded and enclose that predictively 
encoded block along the row or column direction or both 
the row and column directions. Encoding efficiency is 
enhanced by applying Discrete Sine Transform process- 
ing along the interpolation direction, when encoding an 
array of prediction error signal values derived for a 
block, and by executing adaptive prediction by deter- 
mining an optimum interpolation direction, when there 
are two possible directions for deriving predicted pixel 
signal values for a block 
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Description 

BACKGROUND OF THE INVENTION 
Field of Application 



[0001] The present invention relates to an image 
encoding apparatus and method, and corresponding 
decoding apparatus and method for encoding and sub- 
sequently decoding an image which is expressed as a 10 
plurality of pixels, with the operation being based upon 
dividing the image into a plurality of blocks of pixels and 
encoding/decoding these blocks. 
[0002] In particular the invention relates to an inter- 
block interpolative prediction encoding apparatus and 15 
method, whereby the encoding efficiency is enhanced 
by applying inter-block interpolation to predict the pixel 
values of certain blocks of an image, with only resultant 
sets of prediction error values being encoded for such 
blocks. 2Q 

Prior Art Techology 

[0003] One of the basic methods of data compression 
which is generally applied to images which are con- 25 
veyed as respective frames of a digital video signal is to 
process each image as a plurality of blocks of pixels, 
and to utilize the correlation which generally occurs 
within each block to reduce the amount of code which is 
generated, i.e. apply intra-block encoding. Usually, pixel 30 
values of each block are subjected to DCT encoding 
followed by quantization of the DCT coefficients and 
variable-length encoding, to thereby achieve a substan- 
tial degree of data compression. 

[0004] However methods of inter-block encoding have as 
also been proposed for utilizing the correlation which 
often exists between adjacent blocks, i.e.; methods 
whereby blocks of an image are encoded based on pixel 
values of adjacent blocks which have already been 
encoded. An example of such a method is described in 40 
a paper entitled "An Image Data Compression Method 
using Extrapoiative Prediction - Discrete Sine Trans- 
form; in the case of Two-Dimensional Coding", Confer- 
ence on Electronic Information Communication 
document (B).J 71-No. 6 pp 717 - 724 (July, 1988. in 45 
Japan). 

[0005] The basic principles of such a method are illus- 
trated in the diagram of Fig. 18 showing part of a block- 
divided image which is being encoded, in which the 
cross-hatched region 301 consists of respective blocks so 
which have already been encoded, while the blank 
region 300 consists of blocks which are yet to be 
encoded. Numeral 302 denotes a block which is cur- 
rently being encoded, by extrapoiative prediction based 
on pixel values of two adjacent blocks 303, 304 which ss 
have already been encoded. 

[0006] Fig. 16 is a general system block diagram 
showing an example of a prior art type of intra-block 



predictive encoding apparatus which utilizes the princi- 
ples described in the above reference. In the following 
description, video signal values expressing pixels, and 
prediction error signal values, etc. will be simply referred 
as pixel values, prediction error values, etc., for brevity 
of description. In Fig. 16, a raster-scan digital video sig- 
nal is applied from an input terminal 1 to a block conver- 
sion section 51, in which each part of the video signal 
corresponding to an image is divided into a plurality of 
sets of pixel values corresponding to respective blocks 
of pixels, which are supplied to one input of a prediction 
subtractor 4. The prediction subtracter 4 subtracts from 
each pixel value a corresponding predicted value, to 
thereby obtain a prediction error value, which is input to 
an encoding section 52. As described in the above ref- 
erence document, it is preferable for the encoding sec- 
tion 52 to apply DST (Discrete Sine Transform) 
processing rather than DCT processing when encoding 
the prediction error values which are obtained for 
respective pixels of a block by extrapoiative prediction. 
For that reason, the set of prediction error values which 
are derived for a block are subjected to DST processing, 
followed by quantization of the resultant DST coeffi- 
cients, and variable-length encoding. The resultant 
code is supplied to the output terminal 7. and also is 
input to the decoding section 55. The prediction error 
values which have thereby, been encoded by the encod- 
ing section 52 are successively recovered through 
decoding processing which is applied by the decoding 
section 55. Each reconstructed prediction error value 
thus obtained is supplied to one input of a prediction 
adder 1.7. A predicted value for that pixel is generated at 
that time by the block prediction section 53 (based on 
reconstructed pixel values for adjacent pixels, read out 
from the block line memory 54) and supplied to the 
other input of the prediction adder 17, which thereby 
outputs a reconstructed pixel value for the pixel which is 
being processed, That reconstructed pixel value is 
stored in the block line memory 54. 
[0007] The block line memory 54 stores the pixel val- 
ues thus derived in units of blocks, as can be under- 
stood from Fig. 18. i.e. pixel values for successive rows 
of blocks are sequentially derived and stored in the 
block line memory 54, so that pixel values which are 
required for processing the block that is currently being 
encoded will always be available from the block line 
memory 54 when required. 

[0008] Fig. 1 7 is a general system block diagram of an 
inter-block extrapoiative prediction decoding apparatus 
corresponding to the inter-block extrapoiative prediction 
encoding apparatus of Fig. 16. In Fig. 17. the input code 
stream is supplied via input terminal 21 to a decoding 
section 55. in which encoding including inverse DST 
processing is executed, to thereby recover respective 
prediction error values for the pixels of an image. Each 
such prediction error value is added in the prediction 
adder 17 to an inter-block prediction value for that pixel 
which is generated by the block prediction section 53 to 
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thereby obtain reconstructed pixel values. These pixel 
values are supplied to a raster conversion section 61 
and to a block line memory 54. The raster conversion 
section 61 executes processing which is the inverse of 
that executed by the block conversion section 51 of Fig. 
16. to thereby convert the pixel values from being 
arranged in units of blocks into a usual type of raster- 
scan video signal, which is supplied to an output termi- 
nal 24, The operation of the block line memory 54 and 
of the block prediction section 53 is identical to that of 
the encoding apparatus of Fig. 16, with reconstructed 
pixel values being stored in the block line memory 54 as 
successive rows of blocks, with appropriate recon- 
structed pixel values being read out from the block line 
memory 54 and supplied to the block prediction section 
53 as required for deriving each predicted pixel value. 
[0009] Such a method of inter-block encoding can pro- 
vide higher encoding efficiency than is achieved by 
internally encoding all of the blocks of an image mutu- 
ally independently. However it is difficult for such a 
method, based on extrapolation, to generate predicted 
pixel values which will accurately follow variations in the 
contents of an image. Furthermore such a method is 
entirely recursive, so that all of the predicted pixel val- 
ues which are derived for a block (and hence, the result- 
ant prediction error values which are encoded and 
transmitted) are based upon pixel values of adjacent 
blocks which have already been encoded, as illustrated 
by the arrow lines in block 302 of Fig. 18. with the latter 
pixel values being similarly dependent upon pixel values 
of preceding blocks. As a result, if an error arises in the 
code which is generated by the apparatus, i.e.. an error 
occurring during transmission/receiving or record- 
ing/reproduction of the code, then at the time of decod- 
ing the received or reproduced code, the effects of such 
an error will propagate from the block in which the error 
occurs into all of the blocks which are subsequently 
decoded. Thus, even a low rate of occurrence of code 
errors can have a considerable adverse effect upon the 
resultant displayed video image. 
[001 0] The above problems arise from the fact that the 
encoding of an image occurs as a continuous flow in 
which each of the predicted pixel values is derived from 
reconstructed pixel values each of which has been 
derived from a predicted pixel value that was derived 
from reconstructed pixel values, and so on, with the 
operation being purely recursive. The problems also 
arise due to the fact that the prediction is extrapolative. 
being based upon pixel values of two adjacent blocks 
which are located along only two adjacent sides of the 
block which is being encoded. Thus for example in the 
case of the block 302 shown in Fig. 18. if the general 
level of the pixel values in the block 305 is substantially 
higher than that of the pixel values of block 304 and/or 
303 (i.e.. due to a sudden change in brightness level 
within the image), that fact will have no effect upon the 
predicted pixel values which are derived for the block 
302 by the extrapolative prediction process. Thus, a 



method which would provide improved prediction accu- 
racy is desirable. 

SUMMARY OF THE INVENTION 

5 

[0011] It is an objective of the present invention to 
overcome the disadvantages of the prior art set out 
above, by providing an inter-block interpolative predic- 
tion encoding apparatus and corresponding interblock 
io interpolative prediction decoding apparatus, and an 
inter-block interpolative prediction encoding method 
and corresponding inter-block interpolative prediction 
decoding method in which a specific proportion of the 
blocks of an image are independently internally 
is encoded (such blocks being referred to in the following 
description and claims as the independent blocks), with 
the remaining blocks of the image (such blocks being 
referred to herein as the prediction blocks) being predic- 
tively encoded by using interpolated predicted pixel val- 
20 ues which are derived either directly or indirectly from 
pixel values of independent blocks within that image. 
[001 2] As a first basic feature of the invention, the pre- 
dicted pixel values for each of a first set of the prediction 
blocks can be derived by interpolation between pixel 
25 values of an encoded independent block and of a region 
of blocks which have already been encoded (i.e.. a con- 
tinuously extending region consisting of encoded inde- 
pendent blocks and encoded prediction blocks, which is 
successively expanded as encoding of the image pro- 
30 ceeds), while each predicted pixel value for each of the 
remaining prediction blocks is derived as a combination 
of two values derived by interpolation in the row and col- 
umn directions respectively of the image, between pixel 
values of the two most recently encoded ones of the first 
35 set of prediction blocks and pixel values of the afore- 
mentioned already encoded region. Upon completion of 
such operations on three mutually adjacent prediction 
blocks based on the pixel values of an adjoining 
encoded independent block, with the region of already 
40 encoded blocks having been thereby expanded by four 
blocks (e.g.. along the row direction of the image), a 
succeeding encoded independent block which is 
spaced apart from the already encoded region by one 
block in the row and column directions is utilized for 
45 repeating that sequence of operations to encode a fur- 
ther set of three mutually adjacent prediction blocks, to 
thereby further expand the already encoded region. 
That sequence of operations is successively repeated 
until the entire image has been encoded. 
so [0013] As a second basic feature of the invention, 
adaptive prediction may be performed. Rather than 
deriving each predicted pixel value for each of the afore- 
mentioned remaining prediction blocks as a combina- 
tion of two values derived by interpolation in the row and 
55 column directions respectively of the image, a set of 
predicted pixel values derived by interpolation along the 
column direction and a set of predicted pixel values 
derived by interpolation along the row direction can be 



3 



EP 0 895 424 A2 



respectively obtained for such a prediction block, and a 
judgement can then made as to which of these two 
d.rect.ons of interpolation will result in the smaller 
amount of code being generated (i.e. when resultant 
pred.ct.on error values are encoded, such as by DCT « 
processing quantization, and variable-length encoding 
in the usual manner). The set of prediction error values 
which will result in generation of the smaller amount of 
code can then selected to be encoded and output from 
the apparatus. 

[0014] As a third basic feature of the invention for 
improved encoding efficiency, when a set of prediction 
error values for a prediction block have been derived 
based on .nterpolated predicted pixel values which are 
obtained by interpolation along a specific (row or col- ,s 
umn) direction, that set of prediction error values is 
encoded by using one-dimensional DST (Discrete Sine 
Transform) processing along that interpolation direction 
and using one^dimensional DCT (Discrete Cosine 
Transform) processing along the direction perpendicular 20 
to the interpolation direction. When a set of prediction 
error values for a prediction block have been derived 
based on predicted pixel values each of which is a com- 
bination of two values obtained by interpolation along 
the row and column directions respectively, then that set 25 
of pred.ct.on error values is encoded by using orthogo- 
nal DST processing. 

f 8 8 foUrth basic ,eature of tn e invention 
encoding of an image can be performed by dividing the 

oTffl!^ "Lf "l y * b,OCkS> aSSi9nin 9 a* 8 "** °nes 30 
of respective blocks along each row and alternate ones 

of respective blocks along each column of that array as 

independent blocks, and assigning the remaining blocks 

a nHn!l C l 0 'I b,0CkS (S ° ^ 6aCh P rediCti ° n **** iS 

enclosed between a set of four independent blocks) 35 
encoding all of the independent NockTand obta^g 
and storing respective sets of resultant reconstructed 

EZL ° f the encoded "*ependent 

blocks, then us.ng these reconstructed pixel values to 

EEMZ?- of ,h . e prediction b,octe Since each P' e - <° 

18 T^T* 81 tOP and ^ and r '9W ^nd 
left sides thereof between encoded independent blocks 

a set or pred.cted pixel values can be derived for each 
pred.ctron block from interpolated values which are 
StuZ by ^ terpo,ation a,on 9 the row direction and the « 
column direction respectively, using pixel values of the 

vTh fr 9 ,nd !P endent b, °<*s. Each predicted pixel 
vakie for a prediction block can thus be derived as a 
combination of two interpolated values, as described 

values for the case of interpolation along the row direc- 
tion and along the column direction respectively can be 
denved for a prediction block, and a judgement made as 

valuta r6SUlt " 3 S6t ° f Drediction ««r 

values that will generate the smallest amount of code 55 

when encoded, as described above. 

[001 6] As a result, the present invention can provide 

an .nter-block interpolative prediction encoding appara- 



tus (and corresponding inter-block interpolative predic- 
tion decoding apparatus) which is capable of high 
encoding efficiency, through the use of inter-block inter- 
polabve prediction of pixel values within an image 
Encoding efficiency can be further enhanced, when 
encoding an array of prediction error values which have 
been denved by adaptive prediction, i.e. based on inter- 
polation along a specific direction, by applying one- 
d.mens.onal DST processing to the array of prediction 
error values along the interpolation direction when 
encoding the prediction error values. 
[001 7] With the present invention, due to the periodic 
provision of independently internally encoded blocks in 
an .mage, it can be ensured that the effects of any code 
error, at the time of decoding, will not propagate 

totniiL mOS lT ° r ^ Mod " which are ad *<*nt 
to the block in which an error arises 

In 01 ? J ^ C ! 0rC,in9 to ° ne aspect - the inve "«on provides 
an .nter-Wock interpolative prediction encoding appara- 
tus for dividing an image into block units, and executing 
sequential encoding processing, comprising. 

first encoding means for deriving code by inde- 

P J !2 en l if ! ra " b,OCk encodin9 of an dependent 
Wock which is separate from blocks which have 
already been encoded, and for executing local 
decoding of said code to obtain a decoded image 
first predrction means for generating first interpola- 
tive prediction signal values for respective pixels 
wrthm first prediction blocks, from decoded images 
of said blocks which have already been encoded 
and of sa.d independent block, said first prediction 
blocks ; bang sandwiched at the top and bottom or 
to the left and right between said blocks which have 
already been encoded and said independent block 
second encoding means for deriving code by 
encoding prediction error signal values which are 
obtained by subtracting said first interpolative pre- 
diction signal values from respective values of said 
Pixels within said first prediction blocks, and for exe- 

T 1 ?,' 00 ** decoding of said code to obtain 
decoded images, 

second prediction means for generating respective 
second interpolative prediction signal values for pix- 
els wrthm a second prediction block, from decoded 
images of blocks which have already been encoded 
and are located above and below or to the left and 
the right of said second prediction block and from 
said decoded images of said first prediction blocks 
sad second prediction block being sandwiched at 

?L a ^_ ° m and to the left and right between 
said blocks which have already been encoded and 
said first prediction blocks, and 
third encoding means for subtracting said second 
interpolative prediction signal values from respec- 

E^J* PiXe ' S Withi " S6COnd P redic * ion 
Mock, to obtain prediction error signal values and 

for encoding said prediction error signal values 
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[0019] The encoding and decoding of a prediction 
block which are executed within such an apparatus are 
preferably executed in accordance with a direction in 
which interpolative prediction is applied to that block, 
i.e., with one-dimensional Discrete Sine Transform 5 
processing being applied along the vertical direction 
and one-dimensional Discrete Cosine Transform 
processing being applied along the horizontal direction, 
in the case of interpolative prediction along the vertical 
direction, and with one-dimensional Discrete Sine 
Transform processing being applied along the horizon- 
tal direction and one-dimensional Discrete Cosine 
Transform processing being applied along the vertical 
direction in the case of interpolative prediction along the 
horizontal direction. 

[0020] The invention further provides a corresponding 
inter-block interpolative prediction decoding apparatus 
for dividing an image into block units, and executing 
sequential decoding processing, comprising: 

first decoding means for deriving a decoded image 
by independent intra-block decoding of an inde- 
pendent block which is separated from blocks 
which have already been encoded, 
first prediction means for generating first interpola- 
tive prediction signal values for respective pixels of 
first prediction blocks from decoded images of said 
blocks which have been already decoded and of 
said independent block, where each of said first 
prediction blocks is sandwiched at the top and bot- 
tom, or to the left and right, between said decoded 
blocks and said independent block, 
second decoding means for decoding respective 
prediction error signal values for pixels of the first 
prediction block, to obtain decoded prediction error 
signal values, and adding said decoded prediction 
error signal values to respective ones of said first 
interpolative prediction signal values to thereby 
obtain decoded images, 

second prediction means for generating second 
interpolative prediction signal values for respective 
pixels of a second prediction block from decoded 
images of said blocks which have already been 
decoded and from said decoded images of said first 
prediction blocks, said second prediction block 
being sandwiched at top and bottom and to the left 
and right between said blocks which have already 
been decoded and said first prediction blocks, and 
third decoding means for decoding prediction error 
signal values for said second prediction block, to 
obtain decoded prediction error signal values, and 
for adding said decoded prediction error signal val- 
ues to respective ones of said second interpolative 
prediction signal values to obtain a decoded image. 

[0021 ] With such a decoding apparatus too, decoding 
of a prediction bis preferably executed in accordance 
with a direction in which interpolative prediction is 



applied to that block, with one-dimensional Discrete 
Sine Transform processing being applied along the ver- 
tical direction and one-dimensional Discrete Cosine 
Transform processing being applied along the horizon- 
tal direction, in the case of interpolative prediction along 
the vertical direction, and with one-dimensional Dis- 
crete Sine Transform processing being applied along 
the horizontal direction and one-dimensional Discrete 
Cosine Transform processing being applied along the 
vertical direction in the case of interpolative prediction 
along the horizontal direction. 

[0022] .The invention correspondingly provides a 
method of inter-block interpolative prediction encoding 
for dividing an image into block units, and executing 
sequential encoding processing, comprising: 

deriving a first code by independent intra-block 
encoding of an independent block which is sepa- 
rated from blocks which have already been 
encoded, and for executing local decoding of said 
code to obtain a decoded image, 
generating respective first interpolative prediction 
signal values for respective pixels of first prediction 
blocks, from decoded images of said blocks which 
have already been encoded and said independent 
block, said first prediction blocks each being sand- 
wiched at top and bottom or to the left and right 
between said blocks which have already been 
encoded and said independent block, 
deriving a second code by encoding prediction 
error signal values which are obtained by subtract- 
ing said first interpolative prediction signal values 
from respective values of said pixels of said first 
prediction blocks. 

executing local decoding of said second code to 
obtain decoded images, 

generating respective second interpolative predic- 
tion signal values for pixels of a second prediction 
block, from decoded images of said blocks which 
have already been encoded, said second prediction 
block being sandwiched at top and bottom and to 
the left and right between said blocks which have 
already been encoded and said first prediction 
blocks. 

subtracting said second interpolative prediction sig- 
nal values from respective values of said pixels of 
second prediction block, to obtain corresponding 
prediction error signal values, and 
encoding said prediction error signal values to 
obtain a third code. 

[0023] According to another aspect, the invention pro- 
vides an inter-block interpolative prediction decoding 
method for dividing an image into block units, and exe- 
cuting sequential decoding processing, comprising: 

deriving a first decoded image by independent 
intra-block decoding of an independent block which 
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is separated from blocks which have already been 
decoded, 

generating respective first interpolate prediction 
signal values for pixels of first prediction blocks, 
from decoded images of said blocks which have 
already been decoded and of said independent 
block, each of said first prediction blocks being 
sandwiched at top and bottom or to the left and 
right between said blocks which have already been 
encoded and said independent block, 
decoding respective prediction error signal values 
of the first prediction blocks, to obtain decoded pre- 
diction error signal values, and adding said 
decoded prediction error signal values to corre- 
sponding ones of said first interpolative prediction 
signal values to obtain second decoded images, 
generating respective second interpolative predic- 
tion signal values for pixels of a second prediction 
block, from decoded images of said blocks which 
have already been decoded and from said decoded 
images of said first prediction blocks, said second 
prediction block being sandwiched at top and bot- 
tom and to the right and left between said blocks 
which have already been decoded and said first 
prediction blocks, 

decoding respective prediction error signal values 
for pixels of said second prediction block, to obtain 
decoded prediction error signal values, and 
adding said decoded prediction error signal values 
to said second interpolative prediction signal values 
to obtain a third decoded image. 

[0024] According to another aspect, the invention pro- 
vides an inter-block adaptive interpolative prediction 
encoding apparatus for dividing an image into units of 
blocks, executing independent internal encoding of part 
of said blocks and encoding remaining ones of said 
blocks by inter-block prediction, the apparatus compris- 
ing 



first encoding means for executing encoding of 
blocks which are disposed at the top and bottom 
and to the right and left of respective adaptive pre- 
diction blocks which constitute part or all of said 
prediction blocks, to obtain resultant code, and for 
executing decoding of said code to obtain respec- 
tively decoded images, 

adaptive subtractor means for judging an appropri- 
ate prediction direction, based upon said decoded 
images of said blocks disposed at the top and bot- 
tom and to the right and left of said adaptive predic- 
tion block, for thereby deriving, for each pixel within 
said adaptive prediction block, a vertical interpola- 
tive prediction signal value based on said decoded 
images of said blocks disposed at the top and bot- 
tom, and a horizontal interpolative prediction signal 
value based on said decoded images of said blocks 
disposed to the right and left, selecting one of said 
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interpolative prediction signal values based upon 
results of said judgement of prediction direction, 
subtracting each said interpolative prediction signal 
value from a corresponding value of a pixel within 
said adaptive prediction block to obtain a prediction 
error signal value, and 

second encoding means for executing encoding of 
said prediction error signal values to obtain result- 
ant code. 



[0025] With such an inter-block adaptive interpolative 
prediction encoding apparatus, all of said prediction 
blocks may be predetermined as adaptive prediction 
blocks, with said adaptive prediction subtractor means 
15 comprising 



prediction means for deriving, for each pixel of an 
adaptive prediction block which is sandwiched at 
top and bottom and left and right sides thereof 
between respective ones of said independent 
blocks, a vertical interpolative prediction signal 
value from said decoded images of said independ- 
ent blocks disposed to the top and bottom and a 
horizontal interpolative prediction signal value from 
said decoded images of said independent blocks 
disposed to the left and right sides, 
prediction subtractor means for subtracting each 
said vertical interpolative prediction signal value 
from a corresponding value of a pixel within said 
adaptive prediction block to thereby obtain a corre- 
sponding vertical prediction error signal value, and 
for, subtracting each said horizontal interpolative 
prediction signal value from a corresponding value 
of a pixel within said adaptive prediction block to 
thereby obtain a corresponding horizontal predic- 
tion error signal value, and 
encoding efficiency judgement means for estimat- 
ing respective encoding efficiencies for said vertical 
prediction error signal values and said horizontal 
prediction error signal values and selecting the pre- 
diction error signal values which will result in gener- 
ation of a smaller amount of code. 



[0026] Furthermore, such an inter-block adaptive 
45 interpolative prediction encoding apparatus may be 
configured such that each said independent block is dis- 
posed separated from blocks which have already been 
encoded, and said prediction blocks consists of non- 
adaptive prediction blocks each of which is sandwiched 
so at top and bottom or to the right and left between said 
blocks which have already been encoded and said inde- 
pendent blocks and of adaptive prediction blocks each 
of which is sandwiched at top and bottom and to the 
right and left between said blocks which have already 
ss been encoded and said independent blocks. 

[0027] According to another aspect, the invention pro- 
vides an inter-block interpolative prediction decoding 
apparatus for performing independent block predictive 
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decoding of an image which has been encoded by 
being divided into block units, with part of the blocks 
being independent blocks which are independently 
internally encoded and remaining blocks being predic- 
tion blocks which are predictivety encoded, the appara- 5 
tus comprising 

first decoding means for executing decoding of 
blocks disposed at top and bottom and left and right 
sides of each of respective adaptive prediction 10 
blocks which constitute part or all of said prediction 
blocks, 

prediction judgement means for estimating a pre- 
diction direction for each of said adaptive prediction 
blocks, to obtain judgement information, is 
prediction means for deriving an interpolate pre- 
diction signal value for each pixel within said adap- 
tive prediction block by selecting, based on said 
judgement information, either a vertical irrterpola- 
tive prediction signal value obtained using decoded 20 
images of said blocks at top and bottom or a hori- 
zontal interpolative prediction signal value obtained 
using decoded images of said blocks at left and 
right, and 

second decoding means for executing decoding of 25 
prediction error signal values of said adaptive pre- 
diction block to obtain decoded prediction error sig- 
nal values, and adding said decoded prediction 
error signal values to said interpolative prediction 
signal values to obtain a decoded image. 30 

[0028] Such an inter-block interpolative prediction 
decoding apparatus may be configured such that each 
said independent block is separated from blocks which 
have already been encoded and said prediction blocks 35 
consist of non-adaptive prediction blocks each sand- 
wiched at top and bottom or to the right and left sides 
between said blocks which have already been decoded 
and said independent blocks, and adaptive prediction 
blocks each sandwiched at top and bottom and to the 40 
left and right sides between said blocks which have 
already been decoded and said independent blocks. 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 

[0029] 

Fig. 1 is a general system block diagram of a first 
embodiment of an inter-block interpolative predic- 
tion encoding apparatus according to the present so 
invention; 

Fig. 2 is a general system block diagram of an 
embodiment of an inter-block interpolative predic- 
tion decoding apparatus corresponding to the inter- 
block interpolative prediction encoding apparatus of ss 
Fig. 1; 

Fig. 3 is a conceptual diagram for describing suc- 
cessive stages in deriving predicted pixel values for 



respective sets of adjacent prediction blocks, with 
the embodiment of Fig. 1; 

Fig. 4 is a conceptual diagram for illustrating inter- 
block interpolation processing which is executed 
using pixels of mutually adjacent blocks to derive 
predicted pixel values, with the present invention; 
Fig. 5 is a corresponding diagram illustrating exam- 
ples of respective pixel values of pixels in such 
blocks, for the case of linear interpolation; 
Fig. 6 is a general block diagram of an example of a 
prediction signal generating section utilized in the 
inter-block interpolative prediction encoding appa- 
ratus of Fig. 1; 

Fig. 7 is a system block diagram showing the inter- 
nal configuration of an encoding section of the inter- 
block interpolative prediction encoding apparatus of 
Fig. 1, in which one-dimensional DST (Discrete 
Sine Transform) processing is applied to an array of 
prediction error values, along the same direction as 
that used in executing interpolative prediction for 
deriving these values; 

Fig. 8 is a system block diagram of a decoding sec- 
tion of the decoding apparatus embodiment of Fig. 

2; 

Fig. 9 is a general system block diagram of a sec- 
ond embodiment of an inter-block interpolative pre- 
diction encoding apparatus according to the 
present invention, which is an adaptive encoding 
apparatus whereby a judgement is made of an opti- 
mum direction of interpolation for deriving predic- 
tion error values of a prediction block: 
Fig. 10 is a general system block diagram of an 
embodiment of an inter-block interpolative predic- 
tion decoding apparatus corresponding to the inter- 
block interpolative prediction encoding apparatus of 
Fig. 9; 

Fig. 1 1 is a flow diagram showing an example of 
processing executed by an encoding efficiency 
judgement section of the embodiment of Fig. 9, for 
implementing adaptive prediction by determining 
an optimum interpolation direction for predicted 
pixel values; 

Fig. 12 is a flow diagram showing a second exam- 
ple of processing which can be executed by an 
encoding efficiency judgement section, for imple- 
menting adaptive prediction: 
Fig. 13 is a general system block diagram of a third 
embodiment of an inter-block interpolative predic- 
tion encoding apparatus according to the present 
. invention, whereby each of respective prediction 
blocks is enclosed at top and bottom and to the 
right and left between adjacent independently 
encoded blocks; 

Fig. 14 is a general system block diagram of an 
embodiment of an inter-block interpolative predic- 
tion decoding apparatus corresponding to the inter- 
block interpolative prediction encoding apparatus of 
Fig. 13; 
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Fig. 15 is a conceptual diagram for use in describ- 
ing the process of deriving predicted pixel values for 
each of respective prediction blocks, by interpola- 
tion from adjacent independent blocks, with the 
embodiment of Fig. 13; 

Fig. 16 is a general system block diagram of an 
example of a prior art type of inter-block extrapola- 
tive prediction encoding apparatus; 
Fig. 1 7 is a general system block diagram of an 
embodiment of an inter-block interpolative predic- 
tion decoding apparatus corresponding to the inter- 
block interpolative prediction encoding apparatus of 
Fig. 16; and 

Fig. 18 is a conceptual diagram for describing the 
process of deriving predicted pixel values for a pre- 
diction block, by extrapolation from pixel values of 
already encoded blocks, with the inter-block extrap- 
olative prediction encoding apparatus of Fig. 16. 

DESCRI PTION OF PREFERRED EMBODIMENTS 

[0030] A first embodiment of an inter-block interpola- 
tive prediction encoding apparatus according to the 
present invention will be described referring to the gen- 
eral system block diagram of Fig. 1. In Fig. 1, a usual 
type of raster-scan digital video signal is supplied to an 
input terminal 1 , and resultant code is supplied to an 
output terminal 7. A subtracter 4 and prediction adder 
1 7 perform basically the same functions as the corre- 
spondingly designated components in the prior art 
example of Fig. 16 described above. In addition, this 
embodiment includes a block conversion section 2, 
switches 3, 5. 10 and 16, and encoding section 6, block 
memories 9 t 1 1 and a block line memory 15, multipliers 
12 and 14 and adder 13. a prediction signal generating 
section 20, and prediction control section 8 and an 
decoding section 18. The operation of each of the block 
conversion section 2, the encoding section 6, the pre- 
diction control section 8 and the decoding section 1 8 dif- 
fers substantially from that of the block conversion 
section 51 , the encoding section 52, the block prediction 
section 53 and the block conversion section 55 respec- 
tively of the prior art example of Fig. 16 described 
above. 

[0031] The switches 3, 5 and 19 are controlled by con- - 
trol signals 2a generated by the block conversion sec- 
tion 2, which also synchronize the operation of the 
encoding section 6 with that of the switches 3, 5. The 
operation of the switch 10, as well as respective multipli- 
cation factors which are implemented by the multipliers £ 
12, 14 are controlled by control signals 8b, 8a which are 
generated by the prediction control section 8. The pre- 
diction control section 8 also controls data read and 
write operations of the block memories 9, 1 1 and the 
block line memory 15. 5 
[0032] The operation of this embodiment is as follows. 
The input digital video signal from the input terminal 1 
conveys a stream of successive images, i.e., as succes- 



sive frames. In the following, the processing which is 
applied by this embodiment to a single image will be 
described. The pixel values of an image, supplied via 
the input terminal 1 , are arranged by the block conver- 
5 sion section 2 into an array of blocks of pixels, part of 
which is shown in Fig. 3, with sets of pixel values 
respectively corresponding to these blocks being pro- 
duced from the block conversion section 2 in a predeter- 
mined sequence. It will be assumed that in the condition 
w shown in diagram (A) of Fig. 3, the blocks contained 
within the hatched-line region 700 have already been 
encoded by the apparatus, and that the blocks constitut- 
ing the blank region 701 remain to be encoded. In that 
condition, the blocks indicated as A, B, C, D are succes- 
15 sively produced from the block conversion section 2 in 
the sequence D, C, B, A. That is to say, successive sets 
of pixel values of four blocks of two adjacent columns of 
the array of blocks are produced and processed as 
respective sets. In addition, control signals for the 
20 switches 3, 5, 16 and 19 are generated by the block 
conversion section 2 in synchronism with the production 
of these blocks. Such a manner of processing blocks in 
sets of four units at a time is generally used in the prior 
art for processing the luminance component of a video 
25 signal, in the case of the 4:2:0 type of encoding. 

[0033] Each of the D-blocks of such sets of four blocks 
is encoded as an intra-block, while the remaining three 
blocks, i.e. the A-block, the B-block and the C-block are 
each encoded as prediction blocks, as described in the 
30 following. 

[0034] When a D-block is to be encoded, the switches 
3, 5 are set such as to transfer the pixel values of that D- 
block from the output of the block conversion section 2 
to be directly input to the encoding section 6. In the 
35 encoding section 6, that set of pixel values is encoded in 
the usual manner, i.e. by DCT (Discrete Cosine Trans- 
form) processing followed by quantization, and data 
compression encoding of the quantized DCT coeffi- 
cients (such as variable-length encoding), to thereby 
to obtain output code for that D-block, with the code being 
supplied to the output terminal 7. 
[0035] In addition, the code which has thus been gen- 
erated is supplied to the decoding section 18. in which 
the inverse operation to that of the encoding section 6 is 
is applied, to thereby obtain reconstructed pixel values of 
the D-block. At that time, the switch 16 supplies to one 
input of the prediction adder 1 7 a zero state value, while 
the reconstructed pixel values of the D-block are being 
supplied to the other input of the prediction adder 1 7, so 
o that these pixel values are transferred directly to each of 
the block memories 9. 1 1 and the block line memory 1 5, 
to be stored in each these memories. 
[0036] It can thus be understood that in this condition, 
the set of reconstructed pixel values of the D-block, i.e. 
? a block which is separated by one block in the vertical 
(column) direction and by one block in the horizontal 
(row) direction from the region 700 of blocks which have 
already been encoded, have been derived by independ- 
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ent internal encoding and stored in each of the memo- 
ries 9, 11 and 15. The operations which are then 
executed are illustrated by diagram (B) of Fig. 3, i.e. 
Step 2. The reconstructed pixel values which are 
derived for each C-block are stored in one of the block 5 
memories 9, 11. and the reconstructed pixel values 
derived for each B-block are stored in the other. It will be 
assumed in the following that the reconstructed pixel 
values for each C-block are stored in the block memory 
1 1 , while those of each B-block are stored in the block 10 
memory 9. 

[0037] Firstly, the pixel values of the C-block are suc- 
cessively produced from the block conversion section 2, 
with the switch 3 being set to transfer these pixel values 
to one input of the prediction subtractor 4, the switch 5 15 
being set to transfer resultant difference values (i.e. pre- 
diction error values) produced from the prediction sub- 
tractor 4 to the encoding section 6, and the switch 19 
being set to transfer predicted pixel values which are 
produced from the adder 1 3 to the other input of the pre- 20 
diction subtractor 4. As a pixel value of the C-block is 
thus being supplied to the prediction subtractor 4, the 
multipliers 12 and 14 are controlled to operate in con- 
junction with the adder 13 to derive an interpolated pixel 
value corresponding that pixel value of the C-block, by 2s 
utilizing reconstructed pixel values of the adjacent most 
recently encoded D-Wock and of an adjacent block 706 
(i.e., an independent block which has been previously 
encoded) of the already encoded region 700. The inter- 
polation operation is illustrated in Fig. 4 for the cases of 30 
interpolation in both the horizontal and vertical direc- 
tions. In the case of the C-block an interpolated pixel 
value for a pixel value 314 is derived from the recon- 
structed values of two pixels PH1 , PH2 of two adjacent 
edge columns of two adjacent blocks which are dis- 35 
posed at the left side and right side respectively of the 
block which is being encoded. This can be achieved by 
simple linear interpolation as illustrated in Fig. 5, which 
shows an example of pixel values of pixels which lie 
along a common row or column direction in two blocks 40 
which sandwich a prediction block, with respective edge 
pixel values of the two enclosing blocks being desig- 
nated as 61 , 62 respectively, and interpolated pixel val- 
ues derived based on the pixel values 61. 62 being 
designated by numeral 60. 45 
[0038] The value k of the multiplier factors set for the 
multipliers 12 and 1 4 are in the range 1/8 to 8/9 (assum- 
ing an 8 x 8 element block size), with the respective val- 
ues of k that are set of these multipliers being 
determined by the prediction control section 8 in accord- so 
ance with the position (along the interpolation direction) 
of the pixel whose value is being predicted, in relation to 
the reference pixels which are being used for the inter- 
polation. 

[0039] With such an encoding apparatus, it is neces- 55 
sary for the block line memory 15 to be capable of stor- 
ing twice the number of pixel values that must be stored 
by the block line memory 54 of the prior art inter-block 



interpolative prediction encoding apparatus of Fig. 17. 
However it be understood that with such interpolation 
processing, it is not essential to store the pixel values of 
entire blocks in the memories 9. 11 and 15. since it is 
only necessary to use pixels located along respective 
edges of those blocks which are to be used in the next 
interpolation operations, i.e., the edge regions indicated 
by numerals 702. 703, 704 in Fig. 3. 
[0040] Derivation of a predicted pixel value for a pixel 
of the C-block shown in diagram (B) of Fig. 3 is executed 
as follows. The appropriate one of the left-edge recon- 
structed pixel values of the D-block which has just been 
encoded is read out from the block line memory 15 and 
supplied to the multiplier 14. while at the same time the 
appropriate one of the right-edge pixel values of the 
opposing block 706 of the region which has already 
been encoded is read out from the block memory 1 1 
and supplied to the multiplier 12. with requisite multiplier 
factors being established by the control signals 8a from 
the prediction control section 8. The output values from 
the multipliers 12, 14 are summed in the adder 13 to 
obtain the required interpolated pixel value, which is 
then transferred by the switch 19 to an input of the sub- 
tractor 4. At that time, the actual value of that pixel is 
read out from the block conversion section 2 and sup- 
plied to the prediction subtractor 4. The corresponding 
prediction error value is thereby output from the predic- 
tion subtractor 4, and is transferred by the switch 5 to be 
input to the encoding section 6. 
[0041] In that way, a complete set of prediction error 
values for the respective pixels of the C-block are sup- 
plied to the encoding section 6, and encoded. With the 
present invention, rather than apply orthogonal DCT 
processing to such a set of prediction error values, one- 
dimensional DST (Discrete Sine Transform) processing 
is executed along the interpolation direction (i.e. the 
horizontal direction of the array of prediction error val- 
ues) and DCT processing is executed along the direc- 
tion perpendicular to the interpolation direction (i.e.. the 
vertical direction in this case). The resultant transform 
coefficient values are then quantized and encoded in 
the encoding section 6, e.g., by variable-length encod- 
ing, to generate a code portion corresponding to that C- 
block, which is supplied to the output terminal 7 and 
also to the decoding section 18. It is preferable to apply 
1 -dimensional DST processing along the direction in 
which prediction is executed, in order to achieve 
improved encoding efficiency. The code thus derived for 
that C-block is decoded by the decoding section 18, to 
generate a set of reconstructed prediction error values 
respectively corresponding to the pixels of that block, 
with these values being successively applied to one 
input of the prediction adder 1 7. At this time the switch 
16 is set to transfer the corresponding predicted pixel 
values from the adder 13 (via switch 19) to the other 
input of the prediction adder 17. which thereby outputs 
corresponding reconstructed pixel values. The recon- 
structed pixel values for the C-block which are thereby 
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successively derived are stored in the block memory 1 1 
and also in the block line memory 15. 
[0042] The B-block shown in diagram (B) of Fig. 3 is 
then similarly encoded, and a corresponding set of 
reconstructed pixel values derived and stored, in a sim- s 
ilar manner to that described for the C-block. However in 
this case interpolate prediction is executed along the 
vertical direction, i.e. with values used in the interpola- 
tion being obtained as reconstructed pixel values of 
upper edge pixels of the D-Wock which has just been w 
encoded, and lower edge elements of the block 707 of 
the already encoded region, which are respectively read 
out from the block memory 9 and from the block line 
memory 15. The encoding section 6 again applies one- 
dimensional DST processing along the interpolation is 
direction, and one-dimensional DCT processing in the 
direction perpendicular thereto, to the array of prediction 
error values thus obtained by subtracting these pre- 
dicted pixel values from the actual pixel values of the B- 
block. in subtracter 4. The code thus obtained for the B- 20 
block is supplied to the output terminal 7, and a set of 
reconstructed pixel values corresponding to that B- 
block are obtained from the prediction adder 17 are 
stored in the block line memory 1 5 and also in the block 
memory 9. 25 
[0043] The step 3, shown in diagram (C) of Fig. 3 has 
now been reached, in which the A-block is encoded by 
using the sets of reconstructed pixel values which have 
been derived and stored for the C-block and B-block in 
step 2 described above. The operation is essentially 30 
identical to that described above for encoding of the C- 
block and B-block. however in this case, interpolative 
prediction is executed in both the vertical and horizontal 
directions. The conditions of the switches 3, 5. and 16 
are held unchanged from those utilized for encoding of 35 
the C-block and B-block, however the switch 19 is set to 
transfer predicted pixel values which are generated by 
the prediction signal generating section 20 to the predic- 
tion subtracter 4 and to the prediction adder 1 7. 
[0044] Predicted pixel values are derived for the A- 40 
block by interpolation along the vertical direction, i.e.. by 
utilizing appropriate ones of the upper edge recon- 
structed pixel values of the C-block (read out from the 
memory 11) and of the lower edge reconstructed pixel 
values of the block 708 of the region of blocks which 45 
have already been encoded (from memory 15). and by 
interpolation along the horizontal direction, utilizing left- 
edge reconstructed pixel values of the B-block (read out 
from memory 9) and right-edge reconstructed pixel val- 
ues of the opposing block of the already encoded region so 
(from memory 15). Respective pairs of predicted pixel 
values, derived by vertical interpolation and horizontal 
interpolation, are thereby derived for each of the pixels 
of the A-block, and supplied to the prediction signal gen- 
erating section 20 whereby respective combined pre- 55 
dieted pixel values are generated, and supplied to the 
subtracter 4. 

[0045] Various methods could be envisaged for com- 



bining such a pair of predicted pixel values, such as tak- 
ing the average of these values, or the mean square of 
the values. As each such combined predicted pixel 
value for the A-biock is generated by the prediction sig- 
nal generating section 20 and supplied via the switch 19 
to the prediction subtracter 4, the corresponding actual 
pixel value is output from the block conversion section 2 
and supplied to the prediction subtracter 4, to thereby 
derive the corresponding prediction error value, which is 
supplied to the encoding section 6. The set of prediction 
error values which is thereby derived for the A-block is 
then encoded, by the encoding section 6, using DST 
processing along both the row and column directions, 
with the resultant coefficients being encoded as 
described for the B-Wocks and C-blocks, and the result- 
ant code being supplied to the output terminal 7. 
[0046] The next set of four adjacent blocks of the 
image are then encoded in the same manner as 
described above. In that way, successive pairs of rows 
of blocks are sequentially encoded, to encode the entire 
image. 

[0047] If the two interpolated pixel values for each 
pixel of the A-block are derived sequentially, then the 
first value must be held temporarily in memory or in a 
data register within the prediction signal generating sec- 
tion 20. which in that case could have the basic config- 
uration illustrated in Fig. 6. 

[0048] Fig ; 7 shows an example of the internal config- 
uration of the encoding section 6 of the above embodi- 
ment In Fig. 7, control signals expressing block position 
information and the direction in which interpolative pre- 
diction is currently being executed are supplied to a con- 
version control section 206. from the block conversion 
section 2 and the prediction control section 8 respec- 
tively. The conversion control section 206 thereby gen- 
erates control signals for controlling switches 204, 205 
to select the appropriate combination of DCT and DST 
processing to be applied to the set of prediction error 
values derived for a block, along the horizontal and ver- 
tical directions. The resultant coefficients are quantized 
by quantizer 207. and the quantized coefficients 
encoded by a variable-length encoder 208. The "predic- 
tion direction control information" shown in Fig. 7 is not 
utilized with the embodiment of Fig. 1, but may be uti- 
lized with another embodiment of the invention as 
described hereinafter. 

[0049] With such inter-block encoding, it is found that 
the respective DC components of adjacent blocks will 
not differ greatly from one another, i.e.. the respective 
DC coefficients obtained for the blocks by the DCT/DST 
transform processing will tend to vary only gradually, 
from block to block. For that reason, improved encoding 
efficiency can be achieved by applying variable-length 
encoding to the quantized DC coefficients which are 
derived for the blocks of an image, as well as to the AC 
coefficients derived for each block. 
[0050] It can be understood that with the memory allo- 
cation arrangement described above for the block mem- 
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ories 9, 11, the switch 10 is controlled such as to 
transfer an appropriate reconstructed pixel value from 
the block memory 1 1 to the multiplier 12 each time that 
interpolation is to be executed along the horizontal 
direction, using pixel values of a D -block or of a B-block 5 
(read out from memory 1 1) in conjunction with pixel val- 
ues of the already encoded region (read out from mem- 
ory 15), and is controlled such as to transfer an 
appropriate reconstructed pixel value from the block 
memory 9 to the multiplier 12 each time that interpola- i 0 
tion is to be executed along the vertical direction, using 
pixel values of a D-block or of a C-block in conjunction 
with pixel values of the already encoded region. 
[0051] The operation of an embodiment of an inter- 
block interpolative prediction decoding apparatus corre- is 
sponding to the inter-block interpolative prediction 
encoding apparatus of Fig. 1 will be described referring 
to the general system block diagram of Fig. 2. In Fig. 2, 
components having identical functions to components 
of the embodiment of Fig. 1 or the prior art example of 20 
Fig. 17 are designated by identical reference numerals. 
The operation of this inter-block interpolative prediction 
decoding apparatus is substantially identical to that 
whereby reconstructed pixel values are derived in the 
inter-block interpolative prediction encoding apparatus 25 
of Fig. 1 . The code stream which has been generated 
by the inter-block interpolative prediction encoding 
apparatus of Fig. 1 is supplied via an input terminal 21 
to a decoding section 22, in which the respective por- 
tions of that code stream corresponding to the afore- 30 
mentioned A-blocks, B-blocks, C-blocks and D-blocks 
are decoded and sets; of prediction error values respec- 
tively corresponding to the A-blocks, B-blocks and C- 
blocks are thereby obtained, together with respective 
sets of reconstructed pixel values corresponding to the 35 
independent blocks, i.e. to the D-blocks. These sets of 
values corresponding to the respective blocks are out- 
put from the decoding section 22 in the same sequence 
of successive sets of four blocks, as described above for 
the inter-block interpolative prediction encoding appara- 40 

tus of Fig. 1 , i.e. the sequence D, C, B, A. D, C, B, A 

When the decoded pixel values for an independent 
blockj.e. a D-block, are being output from the decoding 
section 22, control signals from the decoding section 22 
hold the switches 3, 5 in a condition for transferring 45 
these pixel values directly to a raster conversion section 
23, and also to be stored in each of the block line mem- 
ory 15 and the block memories 9 and 11. While the 
decoding prediction error values for a prediction block 
are being output from the decoding section 22, the so 
switches 3, 5 transfer these values successively to the 
prediction adder 17, to be added to a corresponding 
predicted pixel value, which is supplied via the switch 
19. The reconstructed pixel values which are thereby 
derived for that prediction block are transferred by the ss 
switch 5 to the raster conversion section 23, and also 
are stored in the block memory 9 or block memory 1 1 . 
That is to say, in the same way as described for the . 



inter -block interpolative prediction encoding apparatus 
of Fig. 1 , it can be assumed that the reconstructed pixel 
values derived for a B-block are stored in the block 
memory 9, while those derived for a C-block are stored 
in the block memory 1 1 . 

[0052] Sets of predicted pixel values are derived each 
B-block and each C-block by vertical interpolation and 
horizontal interpolation respectively, in the same man- 
ner as described above referring to Fig. 3. The resultant 
sets of reconstructed pixel values, stored in the block 
memories 9, 1 1 respectively, are then utilized to obtain 
pairs of predicted pixel values for respective pixels of 
the corresponding A-block, by horizontal and vertical 
interpolation between these pixel values and recon- 
structed pixel values of blocks which have been previ- 
ously decoded, read out from the block line memory 15. 
Resultant combined reconstructed pixel values are 
thereby derived for the A-block by the prediction signal 
generating section 20, and transferred via the switch 19 
to the prediction adder 17. 

[0053] In that way, respective sets of reconstructed 
pixel values are decoded for the set of blocks constitut- 
ing an image, and supplied to the raster conversion sec- 
tion 23, in which the sequence of pixel values of that 
image is restored to that of a normal raster scan video 
signal. The resultant decoded digital video signal is sup- 
plied to the output terminal 24. 

[0054] Fig. 8 shows an example of a suitable configu- 
ration for the decoding section 18 of the encoding appa- 
ratus embodiment of Fig. 1 . The configuration of the 
decoding section 22 of the decoding apparatus of Fig. 2 
can be similar to that shown in Fig. 8, with the addition 
of a capability for generating the necessary switch con- 
trol signals. Since as described above the code portions 
expressing respective blocks of an image are transmit- 
ted in a predetermined sequence by the encoding appa- 
ratus, the block position information can be easily 
derived by the decoding section 22, so that description 
is omitted. The "prediction direction control information** 
shown in Fig. 8 is not utilized with the embodiment of 
Fig. 2, but may be utilized with another embodiment of 
the invention as described hereinafter. 
[0055] A second embodiment of an inter-block inter- 
polative prediction encoding apparatus according to the 
present invention will be described, referring to the gen- 
eral system block diagram of Fig. 9. In Fig. 9, compo- 
nents having identical functions to components of the 
embodiment of Fig. 1 are designated by identical refer- 
ence numerals to those of Fig. 1, and detailed descrip- 
tion of these will be omitted. The overall operation of this 
embodiment is substantially identical to that of the 
embodiment of Fig. 1, differing only with respect to the 
encoding of each A-block, of each of the sets of four A, 
B, C and D-blocks which are sequentially processed as 
described above referring to Fig. 3. Essentially, this 
embodiment differs from that of Fig. 1 by implementing 
adaptive prediction. To achieve this, the embodiment 
includes an encoding efficiency judgement section 33, 
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which is utilized to determine whether the interpolated 
pixel values for an A-block are to be derived by interpo- 
lation along the horizontal or the vertical direction of the 
image. In addition, the embodiment includes a memory 
34 for providing amounts of delay as required for the 5 
time involved in executing judgement operations by the 
encoding efficiency judgement section 33, and two pairs 
of switches 31 , 32 and 38, 40. respectively controlled by 
control signals from the block conversion section 2. The 
switches 31, 32 transfer the prediction error values 10 
derived for a prediction block directly from the prediction 
subtractor 4 to the encoding section 600. when that pre- 
diction block is a B-block or a C-Wock, and transfer the 
prediction error values to be input to the encoding effi- 
ciency judgement section 33, when the prediction block /5 
is an A-block. and transfer a selected set or prediction 
error values for an A-block from the encoding efficiency 
judgement section 33 via switch 5 to the encoding sec- 
tion 600. Also, it is necessary for the encoding section 
600 of this embodiment to execute multiplexing of inter- 20 
polation direction information with the generated code, 
as described hereinafter. In addition, the prediction con- 
trol section 340 controls the interpolation operations 
such that an entire set of predicted pixel values derived 
for an A-block by interpolation along the horizontal 2 s 
direction and an entire set of such pixel values derived 
for that A-block by interpolation along the vertical direc- 
tion are respectively obtained from the adder 13 and 
input to the prediction subtractor 4, so that two sets of 
prediction error values respectively corresponding to 30 
the two interpolation directions are supplied to the 
encoding efficiency judgement section 33. 
[0056] The processing executed to encode each of the 
B, C and D-Wocks is identical to that described for the 
inter-block interpolate prediction encoding apparatus 35 
of Fig. 1. in the case of an A-block, when two sets of 
prediction error values respectively derived based on 
the two possible interpolation directions have been sup- 
plied to the encoding efficiency judgement section 33. 
the encoding efficiency judgement section 33 operates 40 
oh these sets of prediction error values to judge which 
of these sets will result in generation of the smaller 
amount of code, when encoded by the encoding section 
600. Based on the result of that judgement, the encod- 
ing efficiency judgement section 33 selects one of the 45 
two sets of prediction error values to be transferred to 
the encoding section 600. and encoded. 
[0057] It is necessary for the inter-block interpolative 
prediction decoding apparatus to be aware of the inter- 
polation direction which has been selected by the inter- so 
block interpolative prediction encoding apparatus for an 
A-block, at the time of executing decoding of that A- 
block. For that reason, when an A-block is encoded, the 
encoding efficiency judgement section 33 generates 
data (as designated by 33a in Fig. 9) indicative of the ss 
interpolation direction which has been selected for that 
A-block. and supplies the direction indication data to the 
encoding section 600, to be multiplexed with the code 



which is generated by the encoding section 600. 
[0058] The basic operating sequence of the encoding 
efficiency judgement section is illustrated in the flow dia- 
gram of Fig. 11. 

[0059] Various method can be envisaged for judging 
which of two sets of prediction error values will result in 
generation of the smaller amount of code, for an 
encoded A-block. The obvious method is of course to 
directly encode each set, in the same manner as is exe- 
cuted by the encoding section 600. and count the 
respective numbers of code bits which are produced for 
the case of interpolation along the horizontal direction 
and along the vertical direction. A second possible 
method is to calculate the respective averages of the 
two sets of prediction error values derived for an A- 
block. or their respective mean square values, and to 
select the set for which the smallest value is obtained. 
[0060] In encoding the set of pixel values derived for 
an independent block, i.e., a D-block. the encoding sec- 
tion 600 applies orthogonal DCT processing, and in the 
case of the set of prediction error values derived for a fi- 
b-lock or a C-block applies one-dimensional DST 
processing along the interpolation direction and one- 
dimensional DCT processing along the direction per- 
pendicular to the interpolation direction, in the same 
manner as described for the embodiment of Fig. 1. In 
the case of the set or prediction error values derived for 
an A-block by interpolation along a selected direction as 
described above, the encoding section 600 applies one- 
dimensionaJ DST processing to the set of prediction 
error values, along that selected direction. 
[0061] The encoding section 600 of the embodiment 
of Fig. 9 can be configured as shown in Fig. 7, i.e., with 
the prediction direction control information being utilized 
by the conversion control section 206 in determining 
whether DST processing is applied in the vertical direc- 
tion or the horizontal direction to an A-block. 
[0062] Fig. 1 0 is a general system block diagram of an 
embodiment of an inter-block interpolative prediction 
decoding apparatus corresponding to the inter-block 
interpolative prediction encoding apparatus of Fig. 9. 
The operation of the decoding apparatus of Fig. 10 is 
substantially identical to that of the embodiment of Fig. 
2 described above, and differs only with respect to con- 
trol of generating the reconstructed pixel values for each 
A-block. In Fig. 10. the decoding section 45 receives a 
stream of code which has been generated by the inter- 
block interpolative prediction encoding apparatus of Fig. 
9. at an input terminal 21 . and executes decoding of that 
code in the same manner as the decoding section 22 of 
the embodiment of Fig.2, while also executing demulti- 
plexing to separate the data expressing the aforemen- 
tioned interpolation direction information for respective 
A-blocks from the code stream. In Fig. 10, the interpola- 
tion direction data 45a thereby obtained from the decod- 
ing section 45 are supplied to the prediction control 
section 47. The prediction control section 47 performs 
identical processing and control operations to those of 
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the prediction control section 8 of the embodiment of 
Fig. 2, with respect to each of the B, C and D-blocks. 
However when the code for an A-block is decoded by 
the decoding section 45, the prediction control section 
47 determines, from the corresponding interpolation 5 
direction information 45a, the interpolation direction 
which will be utilized. Specifically, assuming the previ- 
ously described assignment of the B and C-blocks to 
the block memories 9, 1 1. if the horizontal interpolation 
direction is indicated, then the switch 10 is set such as 10 
to transfer reconstructed pixel values of the appropriate 
B-block from the block memory 9, whereas if vertical 
interpolation is indicated then the switch 10 is set such 
as to transfer reconstructed pixel values of the appropri- 
ate C -block from the block memory 1 1 . The interpolated 1S 
pixel values which are thereby derived for the A-block 
are supplied to the prediction adder 17 in synchronism 
with read-out of the corresponding ones of the decoded 
prediction error values for that A-block, from the decod- 
ing section 45, to thereby obtain the corresponding 2 o 
reconstructed pixel values, which are transferred by 
switch 5 to the raster conversion section 23. 
[0063] In all other respects, the operation of this inter- 
block interpolative prediction decoding apparatus 
embodiment identical to that of Fig. 2 described above. 2s 
[0064] The decoding section 45 of the embodiment of 
Fig. 10 can be configured as shown in Fig. 8. i.e.. with 
the prediction direction control information being sepa- 
rated from the input code stream by the variable length 
decoder 2 1 0, and utilized by the conversion control sec- ao 
tion 218 in determining whether inverse DST process- 
ing is to be applied in the vertical direction or the 
horizontal direction to the decoded set of prediction 
error values which are derived for an A-bJock. 
[0065] As an alternative to the method of encoding 35 
efficiency judgement which is used with the inter-block 
interpolative prediction encoding apparatus embodi- 
ment of Fig. 9. it is possible to judge the interpolation 
direction for which optimum encoding efficiency will be 
achieved when encoding an A-block, by estimating the 40 
respective degrees of correlation between the recon- 
structed pixel values of each of the two pairs of blocks 
whose values can be used in the interpolation. That is to 
say. referring to diagram (C) of Fig. 3. if for example it is 
judged that there is a higher degree of correlation 45 
between reconstructed pixel values of the B-block (held 
in the block memory 9) and those of the encoded block 
709 (held in the block line memory 15). than there is 
between the reconstructed pixel values of the C-block 
(held in the block memory 1 1 ) and those of the encoded so 
block 708. then the highest encoding efficiency can be 
expected to be achieved if interpolation along the hori- 
zontal direction is utilized for prediction of the A-block 
values. 

[0066] The basic operation in that case is illustrated in 
the flow diagram of Fig. 1 1 . 

[0067] With such an inter-block interpolative predic- 
tion encoding apparatus embodiment which utilizes 



inter-block correlation judgement to determine the 
appropriate interpolation direction to be utilized for 
determining the interpolated pixel values for an A-block. 
it becomes unnecessary to multiplex the interpolation 
direction information with the code which is generated 
by the encoding apparatus, since the operation forjudg- 
ing the respective degrees of correlation can be exe- 
cuted by the inter-block interpolative prediction 
decoding apparatus, through operating on the sets of 
reconstructed pixel values which are derived by the 
decoding apparatus, to thereby obtain the interpolation 
direction information in the same manner as for the 
encoding apparatus. 

[0068] In practice, it would be possible to judge only 
the respective degrees of correlation between the sets 
of reconstructed pixel values which may actually be 
used in the interpolation operation, i.e., the correlation 
between opposing edge columns of reconstructed pixel 
values of the two adjoining (left and right-side) blocks 
which are used in horizontal interpolation of the A-block 
values, and between the opposing edge rows of recon- 
structed pixel values of the two adjoining (upper side 
and lower side) blocks which are used in vertical inter- 
polation. 

[0069] Another embodiment of an inter-block interpo- 
lative prediction encoding apparatus according to the 
present invention will be described referring to the gen- 
eral system block diagram of Fig. 13, in conjunction with 
the block arrangement diagrams of Fig. 15. In Fig. 13, 
components having identical functions to components 
of the preceding inter-block interpolative prediction 
encoding apparatus embodiments are designated by 
identical reference numerals to those of the preceding 
embodiments, and detailed description of these will be 
omitted. In Fig. 13, an input digital video signal is sup- 
plied via an input terminal 1 to a block conversion sec- 
tion 402 and a prediction control section 410. with the 
pixel values of each of respective images expressed by 
the video signal being successively output in a predeter- 
mined sequence as respective blocks of pixel values. 
These consist of independent blocks and prediction 
blocks, with the arrangement of these being illustrated 
in diagram (A) of Fig. 15, which conceptually shows a 
first basic operating step of this embodiment, in which 
all of the independent blocks (each designated as -inde- 
pendent") are sequentially read out from the block con- 
version section 402. As can be understood, with this 
embodiment, when the pixel values of an image which is 
to be encoded are arranged into an array of blocks, 
alternate ones of these blocks along the row direction 
and along the column direction of that array are prede- 
termined as independent blocks and the remaining 
blocks predetermined as prediction blocks, to form a 
checkerboard configuration in which each prediction 
block is enclosed at the right and left sides and the 
upper and lower sides thereof between four independ- 
ent blocks. 

[0070] In step 1 of the operation for encoding an 
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image, the switches 3 and 5 are controlled by the block 
conversion section 402 to transfer the respective sets of 
pixel values of the independent blocks to be succes- 
sively encoded by the encoding section 600. The 
respective code portions thereby derived for the inde- 5 
pendent blocks are supplied to the output terminal 7 and 
also to the decoding section 18, which outputs corre- 
sponding sets of reconstructed pixel values. 
[0071 J In diagram (A) of Fig. 15, the letters A and B 
are assigned to respective ones of the independent 10 
blocks, and the letter C to the prediction blocks. It should 
be understood that these block designations have no 
relationship to the block designations (i.e., A-blocks. B- 
blocks, C -blocks, D-blocks) of the preceding embodi- 
ments. 15 
[0072] In the first step, all of the independent blocks of 
an image are successively read out from the block con- 
version section 402 and encoded in the sequence A, B, 

A, B t A Each set of reconstructed pixel values for 

an independent block of the A set. derived by the decod- 20 
ing section 18, is stored in a predetermined one of the 
two 1/4 frame memories 411, 415, and it will be 
assumed that these sets of values are each stored in 
the 1/4 frame memory 411. Each set of reconstructed 
pixel values derived for an independent block of the B 25 
set is stored in the other one of these memories, i.e., the 
1/4 frame memory 415. Since as can be understood 
from Fig. 15, the total number of independent blocks is 
one half of the total number of blocks constituting an 
image, the maximum amount of storage capacity 30 
required for each of the two memories 411, 415is 1/4 of 
that total, i.e. 1/4 of a frame of the video signal. However 
in actuality, since only the reconstructed pixel values 
derived for the edge pixels of an independent block are 
utilized to derive interpolated pixel values for prediction 35 
blocks, it is only necessary to derive and store these 
reconstructed pixel values of the edge pixels (i.e. the 
two outer rows and two outer columns) of each of the 
independent blocks in the 1/4 frame memories 411. 
415. 40 
[0073] When step 1 has been completed, so that all of 
the independent blocks have been encoded, transmit- 
ted, and the corresponding reconstructed pixel values 
stored in memory, a second basic operating step, step 
2, is executed. Firstly, switches 3 and 5 are controlled 45 
such as to transfer output values from the block conver- 
sion section 402 to be stored in a 1/2 frame memory 
400, and output values from an encoding efficiency 
judgement section 433 to be input to the encoding sec- 
tion 600. Values read out from the 1/2 frame memory so 
400 are supplied to one input of a prediction subtracter 
4, whose output values are supplied to the encoding 
efficiency judgement section 433. Interpolated predic- 
tion values are derived from respective pairs of recon- 
structed pixel values read out from the 1/4 frame ss 
memories 411, 415 respectively, by multipliers 12, 14 
and adder 13 under the control of the prediction control 
section 410, in the same manner as described for the 



preceding inter-block interpolate prediction encoding 
apparatus embodiments. In the initial part of step 2, 
respective sets of pixel values for all of the prediction 
blocks C are read out successively from the block con- 
version section 402 and stored in the 1/2 frame memory 
400. Since the prediction blocks constitute one half of 
the total number of blocks forming an image, the stor- * 
age capacity required for the 1/2 frame memory 400 is 
one half of the number of pixels which form an image, 
i.e. one half of a video signal frame. When the pixel val- 
ues of all of the prediction blocks have been stored in 
the 1/2 frame memory 400, pixel values of a first predic- 
tion block are successively read out from the 1/2 frame 
memory 400, in synchronism with outputting of corre- 
sponding interpolated pixel values from the adder 13. 
As can be understood from diagram (B) of Fig. 15, with 
each of the prediction blocks C being enclosed at the 
right and left sides and at the upper and lower sides 
thereof between opposing adjacent ones of the inde- 
pendent blocks, a predicted pixel value can be derived 
for each pixel of a prediction block by interpolation along 
the horizontal or the vertical direction. That is to say, it is 
possible to obtain a predicted pixel value for such a pixel 
as either a combination of two predicted values derived 
using each of these interpolation directions, as 
described for the A-blocks of the inter-block interpola- 
tive prediction encoding apparatus of Fig. 1 above, or to 
judge whether the horizontal or the vertical interpolation 
direction will provide optimum encoding efficiency, and 
select only the predicted values derived using that 
selected direction, as described for the A-blocks of the 
inter-block interpolative prediction encoding apparatus 
of Fig. 9 above. With the embodiment of Fig. 13 it is 
assumed that the method of selecting a single interpo- 
lation direction for encoding a prediction block, based 
on judgement of optimum encoding efficiency, is uti- 
lized. 

[0074] This with the embodiment of Fig. 1 3. to encode 
a prediction block, a set of prediction error values for 
that block derived based on interpolation along the hor- 
izontal direction of the image (using opposing edge col- 
umns of reconstructed pixel values of the two 
independent blocks which enclose that prediction block 
at the right and left sides thereof, with each pair of 
reconstructed pixel values used to derive an interpo- 
lated value being read out from the 1/4 frame memory 
41 1 and the 1/4 frame memory 415 respectively under 
the control of the prediction control section 410), and a 
set of prediction error values derived based on interpo- 
lation along the vertical direction (using opposing edge 
rows of reconstructed pixel values of the two independ- 
ent blocks which enclose that prediction block at the 
upper and lower sides thereof) are respectively 
obtained from the prediction subtracter 4 and supplied 
to the encoding efficiency judgement section 433: The 
encoding efficiency judgement section 433 judges 
which of these sets of prediction error values will result 
in generation of the smaller amount of code, when 
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encoded, and supplies the selected set to the encoding 
section 600 via the switch 5, while at the same time sup- 
plying data 433a indicative of the selected prediction 
direction to the encoding section 600. The prediction 
direction indication data are multiplexed with the gener- 5 
ated code, by the encoding section 600, and supplied to 
the output terminal 7. 

[0075] When a set of prediction error values for a pre- 
diction block are supplied to the encoding section 600, 
together with the corresponding interpolation direction io 
indication data, the encoding section 600 applies one- 
dimensional DST processing to that set along the 
selected interpolation direction, followed by quantiza- 
tion of the DST coefficients and variable-length encod- 
ing. In the case of encoding the pixel values of an is 
independent block, the encoding section 600 applies 
orthogonal DCT processing followed by quantization of 
the DCT coefficients and variable-length encoding. 
[0076] The above processing is executed for each of 
the prediction blocks in succession, to thereby obtain 20 
and transmit successive code portions combined with 
corresponding interpolation direction indication data for 
each of the prediction blocks, and so complete the proc- 
ess of encoding the image. 

[0077] Alternatively, as described for the A-blocks of 25 
the inter-block interpolate prediction encoding appara- 
tus of Fig. 9. it would be possible to perform the encod- 
ing efficiency judgement, to determine the optimum 
direction of interpolation, based upon comparison of the 
degree of correlation between the two blocks which 30 
enclose a prediction block at the right and left sides 
thereof and the degree of correlation between the two 
blocks which enclose that prediction at the upper and 
lower sides thereof, i.e. with the pair of blocks which 
exhibit the higher degree of correlation being selected 35 
for use in the interpolation. 

[0078] Fig. 1 4 is a general system block diagram of an 
embodiment of an inter-block interpolative prediction 
decoding apparatus corresponding to the inter-block 
interpolative prediction encoding apparatus of Fig. 1 3. A 40 
stream of code including interpolation direction indica- 
tion data combined therein, which has been generated 
by the apparatus of Fig. 13, is supplied via an input ter- 
minal 21 to a decoding section 440 and to a prediction 
control section 426. When code of an independent 45 
block is being received, the 440 controls the switches 3, 
5 to transfer the resultant decoded pixel values to be 
temporarily held in a 1/2 frame memory 451 . and also in 
one of the 1/4 frame memories 41 1 or 415. Thus, all of 
the independent blocks of an image are successively so 
decoded, in the same sequence in which the blocks 
were output from the block conversion section 402 of 
the encoding apparatus, and temporarily stored in the 
1/2 frame memory 451, while also being stored in either 
the 1/4 frame memory 411 or the 1/4 frame memory 55 
415, in the same manner as described for the encoding 
apparatus of Fig. 13. Next, the decoding section 440 
sets the switches 3, 5 to transfer the output of the 



decoding section 440 to the prediction adder 1 7 and the 
output of the prediction adder 17 to the 1/2 frame mem- 
ory 451 , as the set of prediction error values for the first 
prediction block of the image to have been encoded are 
decoded by the decoding section 440 and supplied to 
the prediction adder 17. In synchronism with this, the 
corresponding predicted pixel values for that prediction 
block are derived by interpolation, in the same manner 
as described for the encoding apparatus of Fig. 13, and 
supplied to the prediction adder 17, with the resultant 
reconstructed pixel values for that prediction block being 
successively stored in the 1/2 frame memory 451. 
[0079] At that time, the pixel values of the first inde- 
pendent block (i.e., in Fig. 15, the uppermost left-side 
block) start to be read out from the 1/2 frame memory 
451 and input to the raster conversion section 423. 
When that is completed, the pixel values of the predic- 
tion block which has just been decoded are read out 
from the 1/2 frame memory 451 and transferred to the 
raster conversion section 423. Decoding of the next pre- 
diction block is then executed, and the above process 
repeated. In that way, the array of blocks shown in Fig. 
15 can be supplied to the raster conversion section 423 
as successive blocks along successive rows of that 

array, i.e., in the sequence A, C. B f C, A thereby 

enabling the configuration and operation of the raster 
conversion section 423 to be simplified. The raster con- 
version section 423 operates on the complete set of 
blocks for an image, received in that way. to recover a 
raster-scan video signal, which is supplied to the output 
terminal 24. 

[0080] As can be understood from the above descrip- 
tion of embodiments, the present invention provides the 
following advantages. Firstly, in the case of the inter- 
block interpolative prediction encoding apparatus 
embodiment of Fig. 13. the number of independently 
encoded blocks which are utilized to encode an image 
constitutes only one half of the total number of pixels of 
that image, with the remaining pixel values being 
encoded using interpolative prediction based on the 
independent blocks. Hence, a substantial increase in 
encoding efficiency (or, in the case of an encoding 
apparatus in which the output data rate is controlled to 
be constant, a corresponding improvement in image 
reproduction quality) can be achieved, by comparison 
with a prior art type of encoding apparatus in which all 
blocks of an image are intra-coded. However since 
interpolation is applied, between two adjacent blocks 
disposed at the right and left sides respectively, and/or 
between two adjacent blocks disposed at the upper and 
lower sides respectively of a block for which interpolated 
pixel values are derived, a substantially higher accuracy 
of prediction can be achieved than is possible with an 
encoding apparatus which utilizes extrapolative predic- 
tion to achieve inter-block encoding. 
[0081 ] Furthermore in the case of the inter-block inter- 
polative prediction encoding apparatus embodiment of 
Fig. 1, an even greater improvement of encoding effi- 
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ciency can be achieved, since the number of independ- 
ent blocks is only one quarter of the total number of 
blocks constituting an image. This is made possible by 
processing each of successive sets of four blocks by 
encoding one of the blocks as an independent block, 5 
encoding two of the remaining blocks by interpolative 
prediction using the reconstructed pixel values of that 
encoded independent block and of two previously 
encoded adjacent independent blocks, and encoding 
the fourth block by interpolative prediction using recon- w 
structed pixel values of the two prediction blocks which 
have just been encoded and of two adjacent previously 
encoded blocks. 

[0082] Furthermore, encoding efficiency is further 
improved by encoding each of the sets of prediction is 
error values derived for respective prediction blocks by 
applying one-dimensional DST processing to that set of 
values (i.e., operated on as an array) along the same 
direction as that along which interpolation was per- 
formed when obtaining that set of prediction error val- 20 
ues. 

[0083] Moreover in the case of a prediction block for 
which interpolated pixel values can be derived using 
either of two different interpolation directions, the inven- 
tion enables an inter-block interpolative prediction 2s 
encoding apparatus to be provided whereby judgement 
is performed as to which of these directions will result in 
the higher degree of encoding efficiency, with that inter- 
polation direction then being selected to be utilized. 
[0084] Moreover with the present invention, the effects 30 
of any code error which arises in the course of data 
transmission (or recording/reproduction processing) 
between the encoding apparatus and the inter-block 
interpolative prediction decoding apparatus will be lim- 
ited to the block in which the error arises and, at most, 35 
one or two adjacent blocks of that image. Hence, such 
code errors will have a much smaller adverse effect 
upon the reproduced images than is the case with a 
method such as extrapolative prediction of pixel values, 
with which the effects of a code error can propagate 40 
throughout a number of blocks of an image. 
[0085] An image encoding apparatus for application to 
images expressed as respective frames of a digital 
video signal, whereby an image is converted into an 
array of blocks with specific blocks predetermined as as 
being independent internally encoded blocks (D) and 
the remainder as predictively encoded blocks (A, B, C), 
with predicted pixel signal values for a predictively 
encoded block being derived by interpolation from pixel 
signal values of at least one pair of blocks which have so 
been already encoded and enclose that predictively 
encoded block along the row or column direction or both 
the row and column directions. Encoding efficiency is 
enhanced by applying Discrete Sine Transform process- 
ing along the interpolation direction, when encoding an ss 
array of prediction error signal values derived for a 
block, and by executing adaptive prediction by deter- 
mining an optimum interpolation direction, when there 



are two possible directions for deriving predicted pixel 
signal values for a block. 

Claims 

1. An inter-block interpolative prediction encoding 
apparatus for dividing an image into block units, 
and executing sequential encoding processing, 
comprising: 

first encoding means for deriving code by inde- 
pendent intra-block encoding of an independ- 
ent block which is separate from blocks which 
have already been encoded, and for executing 
local decoding of said code to obtain a 
decoded image, 

first prediction means for generating first inter- 
polative prediction signal values for respective 
pixels within first prediction blocks, from 
decoded images of said blocks which have 
already been encoded and of said independent 
block, said first prediction blocks being sand- 
wiched at the top and bottom or to the left and 
right between said blocks which have already 
been encoded and said independent block, 
second encoding means for deriving code by 
encoding prediction error signal values which 
are obtained by subtracting said first interpola- 
tive prediction signal values from respective 
values of said pixels within said first prediction 
blocks, and for executing local decoding of said 
code to obtain decoded images, 
second prediction means for generating 
respective second interpolative prediction sig- 
nal values for pixels within a second prediction 
block, from decoded images of blocks which 
have already been encoded and are located 
above and below or to the left and the right of 
said second prediction block and from said 
decoded images of said first prediction blocks, 
said second prediction block being sandwiched 
at top and bottom and to the left and right 
between said blocks which have already been 
encoded and said first prediction blocks, and 
third encoding means for subtracting said sec- 
ond interpolative prediction signal values from 
respective values of pixels within said second 
prediction block, to obtain prediction error sig- 
nal values, and for encoding said prediction 
error signal values. 

An inter-block interpolative prediction encoding 
apparatus according to claim 1, wherein encoding 
and decoding of a prediction block are executed in 
accordance with a direction in which interpolative 
prediction is applied to that block, with one-dimen- 
sional Discrete Sine Transform processing being 
applied along the vertical direction and one<limen- 
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3. 
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sional Discrete Cosine Transform processing being 
applied along the horizontal direction, in the case of 
interpolative prediction along the vertical direction, 
and with one-dimensional Discrete Sine Transform 
processing being applied along the horizontal direc- 
tion and one-dimensional Discrete Cosine Trans- 
form processing being applied along the vertical 
direction in the case of interpolative prediction 
along the horizontal direction. 

An inter-block interpolative prediction decoding 
apparatus for dividing an image into block units, 
and executing sequential decoding processing, 
comprising: 

first decoding means for deriving a decoded 
image by independent intra-block decoding of 
an independent block which is separated from 
blocks which have already been encoded, 
first prediction means for generating first inter- 
polative prediction signal values for respective 
pixels of first prediction blocks from decoded 
images of said blocks which have been already 
decoded and of said independent block, where 
each of said first prediction blocks is sand- 
wiched at the top and bottom, or to the left and 
right, between said decoded blocks and said 
independent block. 

second decoding means for decoding respec- 
tive prediction error signal values for pixels of 
the first prediction block, to obtain decoded 
prediction error signal values, and adding said 
decoded prediction error signal values to 
respective ones of said first interpolative pre- 
diction signal values to thereby obtain decoded 
images. 

second prediction means for generating sec- 
ond interpolative prediction signal values for 
respective pixels of a second prediction block 
from decoded images of said blocks which 
have already been decoded and from said 
decoded images of said first prediction blocks, 
said second prediction block being sandwiched 
at top and bottom and to the left and right 
between said blocks which have already been 45 
decoded and said first prediction blocks, and 
third decoding means for decoding prediction 
error signal values for said second prediction 
block, to obtain decoded prediction error signal 
values, and for adding said decoded prediction so 
error signal values to respective ones of said 
second interpolative prediction signal values to 
obtain a decoded image. 



An inter-block predictive encoding apparatus ss 
according to claim 3, wherein decoding of a predic- 
tion block are executed in accordance with a direc- 
tion in which interpolative prediction is applied to 
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that block, with one-dimensional Discrete Sine 
Transform processing being applied along the verti- 
cal direction and one-dimensional Discrete Cosine 
Transform processing being applied along the hori- 
zontal direction, in the case of interpolative predic- 
tion along the vertical direction, and with one- 
dimensional Discrete Sine Transform processing 
being applied along the horizontal direction and 
one-dimensional Discrete Cosine Transform 
processing being applied along the vertical direc- 
tion in the case of interpolative prediction along the 
horizontal direction. 

An inter-block interpolative prediction encoding 
method for dividing an image into block units, and 
executing sequential encoding processing, com- 
prising: 

deriving a first code by independent intra-block 
encoding of an independent block which is sep- 
arated from blocks which have already been 
encoded, and executing local decoding of said 
code to obtain a decoded image, 
generating respective first interpolative predic- 
tion signal values for respective pixels of first 
prediction blocks, from decoded images of said 
blocks which have already been encoded and 
said independent block, said first prediction 
blocks each being sandwiched at top and bot- 
tom or to the left and right between said blocks 
which have already been encoded and said 
independent block, 

deriving a second code by encoding prediction 
error signal values which are obtained by sub- 
tracting said first interpolative prediction signal 
values from respective values of said pixels of 
said first prediction blocks, 
executing local decoding of said second code 
to obtain decoded images, 
generating respective second interpolative pre- 
diction signal values for pixels of a second pre- 
diction block, from decoded images of said 
blocks which have already been encoded, said 
second prediction block being sandwiched at 
top and bottom and to the left and right 
between said blocks which have already been 
encoded and said first prediction blocks, 
subtracting said second interpolative prediction 
signal values from respective values of said 
pixels of second prediction block, to obtain cor- 
responding prediction error signal values, and 
encoding said prediction error signal values to 
obtain a third code. 



6. An inter-block interpolative prediction encoding 
method according to claim 5, wherein encoding and 
decoding of a prediction block is executed in 
accordance with a direction in which interpolative 
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prediction is applied to that block, with one-dimen- 
sional Discrete Sine Transform processing being 
applied along the vertical direction and one-dirnen- 
sional Discrete Cosine Transform processing being 
applied along the horizontal direction, in the case of 
interpolative prediction along the vertical direction, 
and with one-dimensional Discrete Sine Transform 
processing being applied along the horizontal direc- 
tion and one-dimensional Discrete Cosine Trans- 
form processing being applied along the vertical 
direction in the case of interpolative prediction 
along the horizontal direction. 

7. An inter-block interpolative prediction decoding 
method for dividing an image into block units, and 
executing sequential decoding processing, com- 
prising: 

deriving a first decoded image by independent 
intra-block decoding of an independent block 
which is separated from blocks which have 
already been decoded, 

generating respective first interpolative predic- 
tion signal values for pixels of first prediction 
blocks, from decoded images of said blocks 
which have already been decoded and of said 
independent block, each of said first prediction 
blocks being sandwiched at top and bottom or 
to the left and right between said blocks which 
have already been encoded and said inde- 
pendent block. 

decoding respective prediction error signal val- 
ues of the first prediction blocks, to obtain 
decoded prediction error signal values, and 
adding said decoded prediction error signal 
values to corresponding ones of said first inter- 
polative prediction signal values to obtain sec- 
ond decoded images, 

generating respective second interpolative pre- 
diction signal values for pixels of a second pre- 
diction block, from decoded images of said 
blocks which have already been decoded and 
from said decoded images of said first predic- 
tion blocks, said second prediction block being 
sandwiched at top and bottom and to the right 
and left between said blocks which have 
already been decoded and said first prediction 
blocks, 

decoding respective prediction error signal val- 
ues for pixels of said second prediction block, 
to obtain decoded prediction error signal val- 
ues, and 

adding said decoded prediction error signal 
values to said second interpolative prediction 
signal values to obtain a third decoded image. 

8. An inter-block interpolative prediction decoding 
method according to claim 7, wherein decoding of a 



prediction block is executed in accordance with a 
direction in which interpolative prediction is applied 
to that block, with one-dimensional Discrete Sine 
Transform processing being applied along the verti- 

5 cal direction and one-dimensional Discrete Cosine 

Transform processing being applied along the hori- 
zontal direction, in the case of interpolative predic- 
tion along the vertical direction, and with one- 
dimensional Discrete Sine Transform processing 

10 being applied along the horizontal direction and 
one-dimensional Discrete Cosine Transform 
processing being applied along the vertical direc- 
tion in the case of interpolative prediction along the 
horizontal direction. 

15 

9. An inter-block adaptive interpolative prediction 
encoding apparatus for dividing an image into units 
of blocks, executing independent internal encoding 
of part of said blocks and encoding remaining ones 
20 of said blocks by inter-block prediction, the appara- 
tus comprising 

first encoding means for executing encoding of 
blocks which are disposed at the top and bot- 

25 f torn and to the right and left of respective adap- 

tive prediction blocks which constitute part or 
all of said prediction blocks, to obtain resultant 
code, and for executing decoding of said code 
to obtain respectively decoded images, 

?o adaptive subtracter means for judging an 

appropriate prediction direction, based upon 
said decoded images of said blocks disposed 
at the top and bottom and to the right and left of 
said adaptive prediction block, for thereby 

is deriving, for each pixel within said adaptive pre- 

diction block, a vertical interpolative prediction 
signal value based on said decoded images of 
said blocks disposed at the top and bottom, 
and a horizontal interpolative prediction signal 

o value based on said decoded images of said 

blocks disposed to the right and left, selecting 
one of said interpolative prediction signal val- 
ues based upon results of said judgement of 
prediction direction, subtracting each said 

s interpolative prediction signal value from a cor- 

responding value of a pixel within said adaptive 
prediction block to obtain a prediction error sig- 
nal value, and 

second encoding means for executing encod- 
er ing of said prediction error signal values to 
obtain resultant code. 

10. An inter-block adaptive interpolative prediction 
encoding apparatus according to claim 9, wherein 
J all of said prediction blocks are adaptive prediction 
blocks, and wherein said adaptive prediction sub- 
tractor means comprises 
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prediction means for deriving, for each pixel of 
an adaptive prediction block which is sand- 
wiched at top and bottom and left and right 
sides thereof between respective ones of said 
independent blocks, a vertical interpolative pre- 5 
diction signal value from said decoded images 
of said independent blocks disposed to the top 
and bottom and a horizontal interpolative pre- 
diction signal value from said decoded images 
of said independent blocks disposed to the left w 
and right sides, 

prediction subtracter means for subtracting 
each said vertical interpolative prediction sig- 
nal value from a corresponding value of a pixel 
within said adaptive prediction block to thereby is 
obtain a corresponding vertical prediction error 
signal value, and for subtracting each said hor- 
izontal interpolative prediction signal value 
from a corresponding value of a pixel within 
said adaptive prediction block to thereby obtain 20 
a corresponding horizontal prediction error sig- 
nal value, and 

encoding efficiency judgement means for esti- 
mating respective encoding efficiencies for said 
vertical prediction error signal values and said 2s 
horizontal prediction error signal values and 
selecting the prediction error signal values 
which will result in generation of a smaller 
amount of code. 



11. An inter-block adaptive interpolative prediction 
encoding apparatus according to claim 9, wherein 
each said independent block is disposed separated 
from blocks which have already been encoded, and 
wherein said prediction blocks consist of non-adap- 
tive prediction blocks each of which is sandwiched 
at top and bottom or to the right and left between 
said blocks which have already been encoded and 
said independent blocks and of adaptive prediction 
blocks each of which is sandwiched at top and bot- 
tom and to the right and left between said blocks 
which have already been encoded and said inde- 
pendent blocks. 

12. An inter-block interpolative prediction decoding 
apparatus for performing independent block predic- 
tive decoding of an image which has been encoded 
by being divided into block units, with part of the 
blocks being independent blocks which are inde- 
pendently internally encoded and remaining blocks 
being prediction blocks which are predictively 
encoded, the apparatus comprising 

first decoding means for executing decoding of 
blocks disposed at top and bottom and left and 
right sides of each of respective adaptive pre- 
diction blocks which constitute part or all of said 
prediction blocks, 



prediction judgement means for estimating a 
prediction direction for each of said adaptive 
prediction blocks, to obtain judgement informa- 
tion, 

prediction means for deriving an interpolative 
prediction signal value for each pixel within said 
adaptive prediction block by selecting, based 
on said judgement information, either a vertical 
interpolative prediction signal value obtained 
using decoded images of said blocks at top and 
bottom or a horizontal interpolative prediction 
signal value obtained using decoded images of 
said blocks at left and right, and 
second decoding means for executing decod- 
ing of prediction error signal values of said 
adaptive prediction block to obtain decoded 
prediction error signal values, adding said 
decoded prediction error signal values to said 
interpolative prediction signal values to obtain 
a decoded image. 

13. An inter-block interpolative prediction decoding 
apparatus according to claim 12 wherein said inde- 
pendent block is separated from blocks which have 
already been encoded and wherein said prediction 
blocks consist of non-adaptive prediction blocks 
each sandwiched at top and bottom or to the right 
and left sides between said blocks which have 
already been decoded and said independent 
blocks, and adaptive prediction blocks each sand- 
wiched at top and bottom and to the left and right 
sides between said blocks which have already been 
decoded and said independent blocks. 

35 14. An inter-block adaptive interpolative prediction 
encoding method for dividing an image into units of 
blocks, executing independent internal encoding of 
part of said blocks and encoding remaining ones of 
said blocks by inter-block prediction, comprising 

40 

executing encoding of blocks which are dis- 
posed at the top and bottom and to the right 
and left of respective adaptive prediction blocks 
which constitute part or all of said prediction 
45 blocks, to obtain resultant code, and executing 

decoding of said code to obtain respectively 
decoded images, 

judging an appropriate prediction direction, 
based upon said decoded images of said 

so blocks disposed at the top and bottom and to 

the right and left of said adaptive prediction 
block, for thereby deriving, for each pixel within 
said adaptive prediction block, a vertical inter- 
polative prediction signal value based on said 

55 decoded images of said blocks disposed at the 

top and bottom, and a horizontal interpolative 
prediction signal value based on said decoded 
images of said blocks disposed to the right and 
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left. 

selecting one of said interpolative prediction 
signal values based upon results of said judge- 
ment of prediction direction, and subtracting 
each interpolative prediction signal value thus 5 
selected from a corresponding value of a pixel 
within said adaptive prediction block to obtain a 
prediction error signal value, and 
executing encoding of said prediction error sig- 
nal values to obtain resultant code. w 

15. An inter-block adaptive interpolative prediction 
encoding method according to claim 14, wherein all 
of said prediction blocks are processed as adaptive 
prediction blocks, and comprising rs 

deriving, for each pixel of an adaptive predic- 
tion block which is sandwiched at top and bot- 
tom and left and right sides thereof between 
respective independent blocks, a vertical inter- 20 
polative prediction signal value from said 
decoded images of said independent blocks 
disposed at the top and bottom and a horizon- 
tal interpolative prediction signal value from 
said decoded images of respective decoded 25 
images of said independent blocks disposed to 
the left and right sides, 

subtracting each said vertical interpolative pre- 
diction signal value from a corresponding value 
of a pixel within said adaptive prediction block 30 
to thereby obtain a corresponding vertical pre- 
diction error signal value, and for subtracting 
each said horizontal interpolative prediction 1 
signal value from a corresponding value of a 
pixel within said adaptive prediction block to 35 
thereby obtain a corresponding horizontal pre- 
diction error signal value, and 
estimating respective encoding efficiencies for 
said vertical prediction error signal values and 
said horizontal prediction error signal values 40 
and selecting the prediction error signal values 
which will result in generation of a smaller 
amount of code. 

16. An inter-block adaptive interpolative prediction as 
encoding method according to claim 14, wherein 
each said independent block is disposed separated 1 
from blocks which have already been encoded, and 
wherein said prediction blocks are processed as 
non-adaptive prediction blocks each of which is so 
sandwiched at top and bottom or to the right and 
left between said blocks which have already been 
encoded and said independent blocks, and as 
adaptive prediction blocks each of which is sand- 
wiched at top and bottom and to the right and left 55 
between said blocks which have already been 
encoded and said independent blocks. 



17. An inter-block adaptive interpolative prediction 
decoding method for performing independent block 
predictive decoding of an image which has been 
encoded by being divided into block units, with part 
of the blocks being independent blocks which are 
independently internally encoded and remaining 
blocks being prediction blocks which are predic- 
tively encoded, comprising 

executing decoding of blocks disposed at top 
and bottom and left and right sides of each of 
respective adaptive prediction blocks which 
constitute part or all of said prediction blocks, 
estimating an appropriate prediction direction 
for each of said adaptive prediction blocks, to 
obtain judgement information, 
a deriving an interpolative prediction signal 
value for each pixel within said adaptive predic- 
tion block by selecting, based on said judge- 
ment information, either a vertical interpolative 
prediction signal value obtained using decoded 
images of said blocks at top and bottom or a 
horizontal interpolative prediction signal value 
obtained using decoded images of said blocks 
at left and right, and 

executing decoding of prediction error signal 
values of said adaptive prediction block to 
obtain decoded prediction error signal values, 
and adding said decoded prediction error sig- 
nal values to said interpolative prediction signal 
values to obtain a decoded image. 

B. An inter-block adaptive interpolative prediction 
decoding method according to claim 17 wherein 
each said independent block is separated from 
blocks which have already been encoded and 
wherein said prediction blocks consist of non-adap- 
tive prediction blocks each sandwiched at top and 
bottom or to the right and left sides between said 
blocks which have already been decoded and said 
independent blocks, and adaptive prediction blocks 
each sandwiched at top and bottom and to the left 
and right sides between said blocks which have 
already been decoded and said independent 
blocks. 

I An inter-block interpolative prediction encoding 
apparatus for encoding an image expressed as an 
array of pixels by dividing said image into a plurality 
of blocks of pixels, the apparatus comprising 

block conversion means (2) for receiving 
respective pixel signal values corresponding to 
said pixels and outputting said pixel signal val- 
ues arranged as a sequence of sets of pixel 
signal values respectively corresponding to 
said blocks, with specific ones of said blocks 
being predetermined as independent blocks 
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which are to be independently internally 
encoded and remaining ones of said blocks 
predetermined as prediction blocks which are 
to be predictively encoded, 
subtracter means (4) for subtracting from each s 
pixel signal value of each of said prediction 
blocks a corresponding predicted pixel signal 
value, to obtain a corresponding prediction 
error signal value, 

encoding means (6) for encoding said sets of io 
pixel signal values corresponding to said inde- 
pendent blocks to obtain corresponding code 
portions, and for encoding respective sets of 
said prediction error signal values derived for 
said prediction blocks to obtain corresponding is 
code portions, 

decoding means (18) for decoding each of said 
code portions corresponding to said independ- 
ent blocks to obtain a corresponding set of 
reconstructed reconstructed pixel signal val- 20 
ues, and for decoding each of said code por- 
tions corresponding to said sets of prediction 
error signal values corresponding to said pre- 
diction blocks to obtain a corresponding set of 
reconstructed prediction error signal values, 25 
adder means (17) for adding to each of said 
reconstructed prediction error signal values a 
corresponding predicted pixel signal value, to 
obtain a corresponding reconstructed pixel sig- 
nal value, 30 
memory means (9, 11. 15) for storing said 
reconstructed pixel signal values, 
interpolative prediction means (8, 12. 13, 14, 
20) for reading out specific ones of said recon- 
structed pixel signal values from said memory 35 
means and operating thereon to derive respec- 
tive ones of said prediction pixel signal values 
by interpolation, with said interpolation being 
executed based upon said reconstructed pixel 
signal values corresponding to said independ- 40 
ent blocks. 

An inter-block interpolative prediction encoding 
apparatus according to claim 19, wherein said 
sequence of blocks is predetermined such that 45 
when a set of pixel signal values corresponding to 
an independent block is produced from said block 
conversion means said independent block is sepa- 
rated by a spacing of one block in a horizontal direc- 
tion of said image and one block in a vertical so 
direction of said image, from a region formed of 
blocks which have already been encoded, and 
wherein said interpolative prediction means (8, 12, 
13, 14, 20) comprises means for operating on pre- 
diction blocks which are adjacent to each said inde- 55 
pendent block (D) by 

executing interpolation along said vertical 



direction to derive a predicted pixel signal 
value, for each pixel signal value of a first pre- 
diction block (B) which is enclosed at top and 
bottom thereof between said independent 
block (D) and a block of said region (400) which 
has already been encoded, by utilizing respec- 
tive pixel signal values of said independent 
block (D) and said block of the already encoded 
region (400). 

executing interpolation along said horizontal 
direction to derive a predicted pixel signal 
value, for each pixel signal value of a second 
prediction block (C) which is enclosed at a left 
side and right side thereof between said inde- 
pendent block (0) and a block of said region 
(400) which has already been encoded, by uti- 
lizing respective pixel signal values of said 
independent block and said block of the 
already encoded region, and 
upon completion of encoding of said first and 
second prediction blocks, 
executing interpolation along said vertical 
direction to derive a first predicted pixel signal 
value, for each pixel signal value of a third pre- 
diction block (A) which is enclosed at top and 
bottom thereof between a first block of said 
already encoded region (400) and said second 
prediction block (B) and is enclosed at right and 
left sides thereof between said first prediction 
block (C) and a second block of said already 
encoded region (400), by utilizing respective 
pixel signal values of said second prediction 
block (B) and said first block of the already 
encoded region, executing interpolation along 
said horizontal direction for said each pixel sig- 
nal value of the third prediction block (A) to 
derive a second predicted pixel signal value, by 
utilizing respective pixel signal values of said 
first prediction block and said second block of 
the already encoded region, and combining 
said first predicted pixel signal value and sec- 
ond predicted pixel signal value in a predeter- 
mined manner to obtain a combined predicted 
pixel signal value for said each pixel signal 
value of the third prediction block. 

21. An inter-block interpolative prediction encoding 
apparatus according to claim 20, wherein said 
encoding means (6) comprises means (200, 201, 
202, 203, 206) for 

applying one-dimensional Discrete Sine Trans- 
form processing along said vertical direction to 
each set of said prediction error signal values 
which are derived for each of said first predic- 
tion blocks (B) by interpolation along said verti- 
cal direction, and applying one-dimensional 
Discrete Cosine Transformprocessing to said 
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set along said horizontal direction, 
applying said one<limensional Discrete Sine 
Transform processing along said horizontal 
direction to each set of said prediction error sig- 
nal values which are derived for each of said s 
second prediction blocks (C) by interpolation 
along said horizontal direction, and applying 
one-dimensional Discrete Cosine Transform 
processing to said set along said vertical direc- 
tion, and u 
applying orthogonal processing to each set of 
said combined prediction error signal values 
which are derived for each of said third predic- 
tion blocks (A). 

15 

22. An inter-block interpolate prediction decoding 
apparatus for operating on said code generated by 
encoding of an image by the inter-block interpola- 
te prediction encoding apparatus of claim 19, 
comprising 2Q 

decoding means (22) for decoding said code 
portions corresponding to said independent 
blocks to obtain respectively corresponding 
sets of pixel signal values of a reconstructed 25 
independent block, and for decoding said code 
portions corresponding to said sets of predic- 
tion error signal values derived respectively for 
said prediction blocks, to obtain corresponding 
sets of reconstructed prediction error signal 30 
values, 

adder means (17) for adding to each of said 
reconstructed prediction error signal values a 
corresponding predicted pixel signal value, to 
obtain a corresponding reconstructed pixel sig- 35 
nal value, 

memory means (9, 11, 15) for storing said 
reconstructed pixel signal values, and 
interpolative prediction means (8, 12, 13, 14, 
20) for reading out specific ones of said recon- 40 
structed pixel signal values from said memory 
means and operating thereon to derive respec- 
tive ones of said prediction pixel signal values 
by interpolation, said interpolative prediction 
means comprising means for operating on pre- 45 
diction blocks which are adjacent to each said 
reconstructed independent block by 
executing interpolation along said vertical 
direction to obtain a predicted pixel signal 
value, for each pixel signal value of a first pre- so 
diction block which is enclosed at top and bot- 
tom thereof between said independent block 
and a block of a region which has already been 
decoded, by utilizing respective pixel signal val- 
ues of said reconstructed independent block 55 
and said block of the already decoded region, 
executing interpolation along said horizontal 
direction to obtain a predicted pixel signal 



value, for each pixel signal value of a second 
prediction block which is enclosed at a left side 
and right side thereof between said recon- 
structed independent block and a block of said 
region which has already been decoded, by uti- 
lizing respective pixel signal values of said 
reconstructed independent block and said 
block of the already decoded region, and 
upon completion of decoding of said first and 
second prediction blocks, 
executing interpolation along said vertical 
direction to derive a first predicted pixel signal 
value, for each pixel signal value of a third pre- 
diction block which is enclosed at top and bot- 
tom thereof between a first block of said 
already decoded region and said second pre- 
diction block and is enclosed at right and left 
sides thereof between said first prediction block 
and a second block of said already decoded 
' region, by utilizing respective pixel signal val- 
ues of said second prediction block and said 
first block of the already decoded region, exe- 
cuting interpolation along said horizontal direc- 
tion for said each pixel signal value of the third 
prediction block to derive a second predicted 
pixel signal value, by utilizing respective pixel 
signal values of said first prediction block and 
said second block of the already decoded 
region, and combining said first predicted pixel 
signal value and second predicted pixel signal 
value in said predetermined manner to obtain a 
combined predicted pixel signal value for said 
each pixel signal value of the third prediction 
block 

23. An inter-block interpolative prediction encoding 
apparatus according to claim 19 further comprising 
encoding efficiency judgement means (33), 
wherein said sequence of blocks is predetermined 
such that when a set of pixel signal values corre- 
sponding to an independent block is produced from 
said block conversion means said independent 
block is separated by a spacing of one block, in a 
horizontal direction and a vertical direction of said 
image, from a region formed of blocks which have 
already been encoded, and wherein said interpola- 
tive prediction means (8. 12, 13, 14, 20) comprises 
means for operating on prediction blocks which are 
adjacent to each said independent block by 

executing interpolation along said vertical 
direction to obtain a predicted pixel signal 
value, for each pixel signal value of a first pre- 
diction block which is enclosed at top and bot- 
tom thereof between said independent block 
and a block of said region which has already 
been encoded, by utilizing respective pixel sig- 
nal values of said independent block and said 
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block of the already encoded region, 
executing interpolation along said horizontal 
direction to obtain a predicted pixel signal 
value, for each pixel signal value of a second 
prediction block which is enclosed at a left side 5 
and right side thereof between said independ- 
ent block and a block of said region which has 
already been encoded, by utilizing respective 
pixel signal values of said independent block 
and said block of the already encoded region, 10 
and 

upon completion of encoding of said first and 
second prediction blocks, 
executing interpolation along said vertical 
direction to derive a vertical predicted pixel sig- is 
nal value, for each pixel signal value of a third 
prediction block which is enclosed at top and 
bottom thereof between a first block of said 
already encoded region and said second pre- 
diction block and is enclosed at right and left 20 
sides thereof between said first prediction block 
and a second block of said already encoded 
region, by utilizing respective pixel signal val- 
ues of said second prediction block and said 
first block of the already encoded region, to 25 
thereby obtain from said subtractor means (4) 
a set of vertical prediction error signal values 
corresponding to said third prediction block, 
and executing interpolation along said horizon- 
tal direction for said each pixel signal value of 30 
the third prediction block to derive a horizontal 
predicted pixel signal value, by utilizing respec- 
tive pixel signal values of said first prediction 
block and said second block of the already 
encoded region, to thereby obtain from said 35 
subtractor means (4) a set of horizontal predic- 
tion error signal values corresponding to said 
third prediction block, 

and wherein said encoding efficiency judge- 
ment means (33) operates on said set of verti- 40 
cat prediction error signal values and said set 
of horizontal prediction error signal values to 
determine one of said sets which, when 
encoded, will result in a smaller amount of gen- 
erated code, controls said selection means to 45 
select said set which will result in generation of 
the smaller amount of code, to be transferred to 
said encoding means (600) for encoding, gen- 
erates prediction direction information corre- 
sponding to said selected set, and supplies so 
said prediction direction information to said 
encoding means (600) to be combined with 
said code which is generated by said encoding 
means. 



55 



An inter-block interpolate prediction encoding 
apparatus according to claim 23, wherein said 
encoding means (6) comprises means (200, 201, 



202, 203. 206) for 

applying one-dimensional Discrete Sine Trans- 
form processing along said vertical direction to 
each set of said prediction error signal values 
which are derived for each of said first predic- 
tion blocks (B) by interpolation along said verti- 
cal direction, and applying one-dimensional 
Discrete Cosine Transform processing to said 
set along said horizontal direction, 
applying said one-dimensional Discrete Sine 
Transform processing along said horizontal 
direction to each set of said prediction error sig- 
nal values which are derived for each of said 
second prediction blocks (C) by interpolation 
along said horizontal direction, and applying 
one-dimensional Discrete Cosine Transform 
processing to said set along said vertical direc- 
tion, 
and 

when said vertical set of prediction error signal 
values is selected for said third prediction block 
(A) by said selection means, applying said one- 
dimensional Discrete Sine Transform to said 
set along said vertical direction and applying 
said one<limensional Discrete Cosine Trans- 
form processing to said set along said horizon- 
tal direction, and when said horizontal set of 
prediction error signal values is selected for 
said third prediction block (A) by said selection 
means, applying said one-dimensional Dis- 
crete Sine Transform processing to said set 
along said horizontal direction and applying 
said one-dimensional Discrete Cosine Trans- 
form processing to said set along said vertical 
direction. 

25. An inter-block interpotative prediction decoding 
apparatus for operating on said code generated by 
encoding of an image by the inter-block interpota- 
tive prediction encoding apparatus of claim 23. 
comprising 

decoding means (45) for separating said pre- 
diction direction information from said code, for 
decoding said code corresponding to said inde- 
pendent blocks to obtain respectively corre- 
sponding sets of pixel signal values of a 
reconstructed independent block, and for 
decoding said code corresponding to of said 
sets of prediction error signal values derived 
respectively for said prediction blocks, to obtain 
corresponding sets of reconstructed prediction 
error signal values, 

adder means (17) for adding to each of said 
reconstructed prediction error signal values a 
corresponding predicted pixel signal value, to 
obtain a corresponding reconstructed pixel sig- 
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nal value, 

memory means (9. 11, 15) for storing said 
reconstructed pixel signal values, and 
interpolate prediction means (prediction con- 
trol section 47, 12, 13, 14) for reading out spe- s 
cific ones of said reconstructed pixel signal 
values from said memory means and operating 
thereon to derive respective ones of said pre- 
diction pixel signal values by interpolation, said 
interpolate prediction means comprising 10 
means for operating on prediction blocks which 
are adjacent to each said reconstructed inde- 
pendent block by 

executing interpolation along said vertical 
direction to obtain a predicted pixel signal is 
value, for each pixel signal value of a first pre- 
diction block which is enclosed at top and bot- 
tom thereof between said independent block 
and a block of a region which has already been 
decoded, by utilizing respective pixel signal val- 20 
ues of said reconstructed independent block 
and said block of the already decoded region, 
executing interpolation along said horizontal 
direction to obtain a predicted pixel signal 
value, for each pixel signal value of a second 25 
prediction block which is enclosed at a left side 
and right side thereof between said recon- 
structed independent block and a block of said 
region which has already been decoded, by uti- 
lizing respective pixel signal values of said 30 
reconstructed independent block and said 
block of the already decoded region, and 
upon completion of decoding of said first and 
second prediction blocks, 

executing interpolation along a direction sped- 35 
fied by said prediction direction information to 
derive a predicted pixel signal value for each 
pixel signal value of a third prediction block 
which is enclosed at top and bottom thereof 
between a first block of said already decoded 40 
region and said second prediction block and is 
enclosed at right and left sides thereof between 
said first prediction block and a second block of 
said already decoded region, by utilizing 
respective pixel signal values of one of said 45 
blocks of the already decoded region and an 
opposing one of said first prediction block and 
second prediction block 

26. An inter-block interpolative prediction encoding so 
apparatus for encoding an image expressed as an 
array of pixels by dividing said image into an array 
of blocks of pixels, the apparatus comprising 

block conversion means (402) for receiving 55 
respective pixel signal values corresponding to 
said pixels and outputting said pixel signal val- 
ues arranged as sets of pixel signal values 



respectively corresponding to said blocks, with 
specific ones of said blocks being predeter- 
mined as independent blocks which are to be 
independently internally encoded and remain- 
ing ones of said blocks predetermined as pre- 
diction blocks which are to be predictively 
encoded, with said independent blocks occur- 
. ring in alternation with respective ones of said 
prediction blocks along each of respective rows 
and columns of said array of blocks 
first memory means (400) for receiving and 
storing all of respective pixel signal values of 
said prediction blocks, in an initial stage of 
operation which is executed prior to encoding 
of said prediction blocks, 
subtracter means (4) for subtracting from each 
pixel signal value of said prediction blocks a 
corresponding predicted pixel signal value, to 
obtain a corresponding prediction error signal 
value, 

encoding means (18) for encoding said sets of 
pixel signal values corresponding to said inde- 
pendent blocks to obtain corresponding code 
portions, and for encoding selected sets of 
pixel signal values corresponding to said pre- 
diction blocks to obtain corresponding code 
portions. 

encoding efficiency judgement means (433) for 
operating on said prediction error signal values 
to judge respective amounts of code which will 
be generated by encoding specific ones of said 
sets of prediction error signal values, and for 
controlling transfer of said sets of prediction 
error signal values to be encoded by said 
encoding means (600). in accordance with 
judgement results obtained thereby, 
decoding means (18) for decoding said code 
portions corresponding to each of said inde- 
pendent blocks to obtain a corresponding set of 
reconstructed pixel signal values, 
second memory means (411. 415) for storing 
all of said reconstructed pixel signal values dur- 
ing said initial stage of operation, and 
interpolative prediction means (410, 12, 13, 14) 
for controlling read-out of said prediction blocks 
and reconstructed independent blocks from 
said first and second memory means in a pre- 
determined sequence, and for operating on 
each of said prediction blocks by 
executing interpolation along said vertical 
direction to derive a vertical predicted pixel sig- 
nal value corresponding to each pixel of said 
prediction block by utilizing respective pixel sig- 
nal values of a first independent block and sec- 
ond independent block which are disposed 
adjacent to upper and lower sides of said pre- 
diction block respectively, to thereby obtain 
from said subtracter means (4) a set of vertical 
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prediction error signal values corresponding to 
said prediction block, executing interpolation 
along said horizontal direction for said each 
pixel signal value of the prediction block to 
derive a horizontal predicted pixel signal value, 5 
by utilizing respective pixel signal values of a 
third independent block and fourth independent 
block which are disposed at said right and left 
sides of said prediction block respectively, to 
thereby obtain from said subtractor means (4) 10 
a set of horizontal prediction error signal values 
corresponding to said prediction block, 
and wherein said encoding efficiency judge- 
ment means (433) operates on said set of ver- 
tical prediction error signal values and said set 15 
of horizontal prediction error signal values to 
determine one of said sets which, when 
encoded, will result in a smaller amount of gen- 
erated code, selects said one of the set of ver- 
tical prediction error signal values and set of 20 
horizontal prediction error signal values which 
will result in generation of the smaller amount 
of code, to be transferred to said encoding 
means (600) for encoding, generates predic- 
tion direction information indicative of the one 25 
of said sets of vertical prediction error signal 
values and horizontal prediction error signal 
values that has been selected, and supplies 
said prediction direction information to said 
encoding means (600) to be combined with 30 
said code which is generated by said encoding 
means. 

27. Art inter-block interpolate prediction encoding 
apparatus according to claim 26 wherein said 35 
encoding means (600) comprises means function- 
ing, when said vertical set of prediction error signal 
values is selected for said prediction block by said 
encoding efficiency judgement means (433). to 
apply said one-dimensional Discrete Sine Trans- 40 
form to said set along said vertical direction and 
apply said one-dimensional Discrete Cosine Trans- 
form processing to said set along said horizontal 
direction, and, when said horizontal set of predic- 
tion error signal values is selected for said predic- 
tion block by said encoding efficiency judgement 
means (433), to apply said one-dimensional Dis- 
crete Sine Transform processing to said set along 
said horizontal direction and apply said one-dimen- 
sional Discrete Cosine Transform processing to 
said set along said vertical direction. 

28. An inter-block interpolate prediction decoding 
apparatus for operating on said code generated by 
encoding of an image by the inter-block interpola- 
te prediction encoding apparatus of claim 26. 
comprising 



first memory means (411. 415). and block 
reconversion means (451, 452) including sec- 
ond memory means (451). 
decoding means (440) for separating said pre- 
diction direction information from said code, 
and for decoding said code portions respec- 
tively corresponding to said independent 
blocks to obtain corresponding sets of decoded 
pixel signal values, and successively storing 
each of said decoded pixel signal values in said 
second memory means 401 and in said first 
memory means (411. 415). in a first stage of 
operation which is executed prior to decoding 
of said prediction blocks, and for thereafter suc- 
cessively decoding said code portions respec- 
tively corresponding to said prediction blocks to 
obtain corresponding sets of decoded predic- 
tion error signal values, 
adder means (170) for adding to each of said 
decoded prediction error signal values a corre- 
sponding predicted pixel signal value, to obtain 
a corresponding reconstructed pixel signal 
value, and 

interpolate prediction means (426) for read- 
ing out specific ones of said decoded pixel sig- 
nal values from said first memory means (411, 
415) and operating thereon to derive respec- 
tive ones of said prediction pixel signal values 
for a prediction block by interpolation along a 
direction which is specified by said prediction 
direction information, utilizing respective 
decoded pixel signal values of two of said inde- 
pendent blocks which enclose said prediction 
block, and successively supplying said predic- 
tion pixel signal values to said adder means 
(17). 

wherein said block reconversion means (451. 
452) is controlled by said prediction control 
means (426) for reading out successive ones of 
said stored sets of decoded pixel signal values 
corresponding to said independent blocks in 
alternation with derivation of respective sets of 
said reconstructed pixel signal values corre- 
sponding to said prediction blocks, in an appro- 
priate sequence for reconstituting said image 
as said array of pixels. 
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FIG. 4 
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C START ) 



OPERATE ON THE SET OF PREDICTION ERROR 
SIGNAL VALUES OBTAINED FOR THE A-BLOCK 
BY INTERPOLATION ALONG THE HORIZONTAL 
DIRECTION, TO ESTIMATE THE AMOUNT OF 
CODE WHICH WILL BE GENERATED BY 
ENCODING THAT SET 



OPERATE ON THE SET OF PREDICTION ERROR 
SIGNAL VALUES OBTAINED FOR THE A-BLOCK 
BY INTERPOLATION ALONG THE VERTICAL 
DIRECTION, TO ESTIMATE THE AMOUNT OF 
CODE WHICH WILL BE GENERATED BY 
ENCODING THAT SET 



COMPARE THE RESPECTIVE ESTIMATED 
AMOUNTS OF CODE. TO DETERMINE THE 
OPTIMUM DIRECTION FOR INTERPOLATE 
PREDICTION OF THAT A-BLOCK 



SELECT THE SET OF PREDICTION ERROR 
SIGNAL VALUES CORRESPONDING TO THE 
OPTIMUM INTERPOLATION DIRECTION, AND 
TRANSFER THAT SET TO BE ENCODED 
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FIG. 12 



( START ) 



READ OUT AND OPERATE ON THE RESPECTIVE 
SETS OF RECONSTRUCTED PIXEL VALUES 
DERIVED FOR THE TWO BLOCKS ADJACENT TO 
THE RIGHT AND LEFT SIDES OF THE A-BLOCK, 
TO ESTIMATE THE DEGREE OF CORRELATION 
BETWEEN THESE ADJACENT BLOCKS 



READ OUT AND OPERATE ON THE RESPECTIVE 
SETS OF RECONSTRUCTED PIXEL VALUES 
DERIVED FOR THE TWO BLOCKS ADJACENT TO 
THE UPPER AND LOWER SIDES OF THE A-BLOCK, 
TO ESTIMATE THE DEGREE OF CORRELATION 
BETWEEN THESE ADJACENT BLOCKS 



COMPARE THE RESPECTIVE DEGREES OF 
CORRELATION, TO DETERMINE THE OPTIMUM 
DIRECTION FOR INTERPOLATE PREDICTION 
OF THAT A-BLOCK 



OBTAIN A SET OF PREDICTION ERROR SIGNAL 
VALUES FOR THE A-BLOCK BASED ON 
INTERPOLATION ALONG THE OPTIMUM 
DIRECTION, AND TRANSFER THAT 
SET TO BE ENCODED 
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